00000001:02000400:2.0F:1782607400.153382:0:2972:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1782607421.549062:0:3192:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-server.virtnet: executing load_modules_local 00000001:01000000:0.0F:1782607423.764514:0:3236:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 775 MB/s 00000001:01000000:3.0:1782607424.014633:0:3236:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 695 MB/s 00000001:01000000:3.0:1782607424.266452:0:3236:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2809 MB/s 00000020:02000000:3.0:1782607425.216134:0:3285:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_105_g3b83550 00000400:02000000:2.0:1782607426.230385:0:3300:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.202.104@tcp [8/256/0/180] 00008000:02000000:0.0:1782607430.434306:0:3449:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1782607478.216995:0:5261:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1782607488.108410:0:5783:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1782607488.108417:0:5783:0:(obd_mount.c:917:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1782607488.109459:0:5783:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000d0285cdc 00000080:02000400:3.0:1782607488.109473:0:5783:0:(super25.c:155:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1782607488.114913:0:5783:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1782607488.114927:0:5783:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1782607488.114966:0:5783:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000429c9fe7) 00000020:00000080:3.0:1782607488.114985:0:5783:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1782607488.131231:0:5783:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1782607488.132019:0:5783:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0F:1782607488.151853:0:5783:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1782607488.151907:0:5783:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1782607488.151930:0:5783:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1782607488.151980:0:5783:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1782607488.152005:0:5783:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1782607488.152330:0:5783:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1782607488.152338:0:5783:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1782607488.152349:0:5783:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8109266df35cae00 00000020:01000004:1.0:1782607488.152356:0:5783:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1782607488.152361:0:5783:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1782607488.152365:0:5783:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000d0285cdc from MGS 00000020:01000004:1.0:1782607488.152369:0:5783:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1782607488.152389:0:5783:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000093f022a1) 00000020:00000080:1.0:1782607488.152401:0:5783:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1782607488.152499:0:5783:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d0285cdc from MGS, refs=2 00080000:01000000:1.0:1782607488.152505:0:5783:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1782607488.152622:0:5783:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8109266df35cae0e 00000100:00100000:1.0:1782607488.152912:0:5783:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1782607488.153028:0:5783:0:(service.c:3461:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1782607488.153034:0:5783:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1782607488.153881:0:5783:0:(service.c:3461:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1782607488.153888:0:5783:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1782607488.154631:0:5783:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782607488.154887:0:5783:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1782607488.154893:0:5783:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1782607488.155656:0:5783:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1782607488.155663:0:5783:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1782607488.158122:0:5783:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1782607488.158140:0:5783:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1782607488.159334:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607488.159338:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607488.159339:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607488.160727:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607488.160733:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607488.160735:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607488.167649:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607488.168099:0:5783:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00000001:01000000:2.0:1782607488.418576:0:5783:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2363 MB/s 00000001:01000000:2.0:1782607488.667875:0:5783:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3451 MB/s 00000001:01000000:0.0:1782607488.918156:0:5783:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 455 MB/s 00000001:01000000:2.0:1782607489.168407:0:5783:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 859 MB/s 00080000:10000000:2.0:1782607489.180571:0:5783:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1782607489.204270:0:5783:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1782607489.204286:0:5783:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1782607489.204288:0:5783:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1782607489.205663:0:5794:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1782607489.205734:0:5783:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1782607489.206096:0:5783:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1782607489.206328:0:5783:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1782607489.206356:0:5783:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1782607489.207545:0:5783:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782607489.210136:0:5783:0:(service.c:3461:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1782607489.210149:0:5783:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1782607489.220797:0:5783:0:(service.c:3461:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1782607489.220811:0:5783:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00010000:00010000:2.0:1782607489.220958:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607489.221297:0:5783:0:(service.c:3461:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1782607489.221303:0:5783:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1782607489.222045:0:5783:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1782607489.222064:0:5783:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.202.104@tcp' 00000020:01000004:1.0:1782607489.222066:0:5783:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1782607489.222113:0:5783:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.202.104@tcp (typ=mgc) 00000020:00000080:1.0:1782607489.222126:0:5783:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.104@tcp (000000007f042e54) 00000020:00000080:1.0:1782607489.222144:0:5783:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1782607489.222212:0:5783:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000473d3894@MGC192.168.202.104@tcp: add connection 192.168.202.104@tcp at head 00010000:00010000:1.0:1782607489.222384:0:5783:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.104@tcp-0 is initialized 00000040:01000000:1.0:1782607489.222391:0:5783:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.104@tcp ctxt 1 is initialized 10000000:01000000:1.0:1782607489.224187:0:5800:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1782607489.224231:0:5783:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.104@tcp (uuid fae11c6e-4506-4104-bb8c-df42498f7e08) 00000020:00000080:1.0:1782607489.224253:0:5783:0:(genops.c:1406:class_connect()) connect: client fae11c6e-4506-4104-bb8c-df42498f7e08, cookie 0x8109266df35cae1c 00000100:00080000:1.0:1782607489.224264:0:5783:0:(import.c:512:import_select_connection()) MGC192.168.202.104@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782607489.224270:0:5783:0:(import.c:626:import_select_connection()) MGC192.168.202.104@tcp: import 00000000473d3894 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1782607489.224308:0:5783:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000028ad9edb x1869199364325504/t0(0) o250->MGC192.168.202.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782607489.224329:0:5783:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import fae11c6e-4506-4104-bb8c-df42498f7e08->MGS 00000020:01000004:1.0:1782607489.224345:0:5783:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1782607489.224350:0:5783:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1782607489.224363:0:5783:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000003d44c31e) 00000020:00000080:1.0:1782607489.224373:0:5783:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1782607489.239200:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000028ad9edb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fae11c6e-4506-4104-bb8c-df42498f7e08:3315:1869199364325504:0@lo:250: 00000100:00100000:0.0:1782607489.240802:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607489.241024:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364325504 00000100:00100000:0.0:1782607489.241032:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364325504 00000100:00100000:0.0:1782607489.241072:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782607489.241078:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000057316dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3315:x1869199364325504:12345-0@lo:250: 00010000:00080000:0.0:1782607489.241104:0:5795:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from fae11c6e-4506-4104-bb8c-df42498f7e08@0@lo t0 exp 0000000000000000 cur 148 last 0 00000020:00000080:0.0:1782607489.241141:0:5795:0:(genops.c:1406:class_connect()) connect: client fae11c6e-4506-4104-bb8c-df42498f7e08, cookie 0x8109266df35cae2a 00000100:00080000:0.0:1782607489.241259:0:5795:0:(import.c:65:import_set_state_nolock()) 0000000086c5de97 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782607489.241312:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000057316dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+5:3315:x1869199364325504:12345-0@lo:250: Request processed in 233us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607489.241320:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782607489.241383:0:3315:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.202.104@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1782607489.241391:0:3315:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.202.104@tcp: connect to target with instance 0 00000100:00080000:0.0:1782607489.241398:0:3315:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.202.104@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1782607489.241403:0:3315:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1782607489.241406:0:3315:0:(import.c:65:import_set_state_nolock()) 00000000473d3894 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1782607489.241408:0:3315:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1782607489.241411:0:3315:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1782607489.241415:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000028ad9edb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fae11c6e-4506-4104-bb8c-df42498f7e08:3315:1869199364325504:0@lo:250: 00000100:00080000:0.0:1782607489.242141:0:5799:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:1.0:1782607489.254983:0:5783:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782607489.255177:0:5783:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1782607489.255183:0:5783:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1782607489.258607:0:5783:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1782607489.258618:0:5783:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1782607489.259506:0:5783:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1782607489.259519:0:5783:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1782607489.260590:0:5783:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782607489.261162:0:5783:0:(service.c:3461:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1782607489.261167:0:5783:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1782607489.266559:0:5783:0:(service.c:3461:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1782607489.266581:0:5783:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1782607489.322990:0:5783:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782607489.323557:0:5783:0:(service.c:3461:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1782607489.323564:0:5783:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1782607489.331475:0:5783:0:(service.c:3461:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1782607489.331490:0:5783:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1782607489.332759:0:5783:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782607489.333142:0:5783:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1782607489.333148:0:5783:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1782607489.335382:0:5783:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1782607489.335393:0:5783:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1782607489.336218:0:5783:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782607489.336695:0:5783:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1782607489.336706:0:5783:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1782607489.337568:0:5783:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1782607489.337576:0:5783:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1782607489.341650:0:5783:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782607489.342140:0:5783:0:(service.c:3461:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1782607489.342148:0:5783:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1782607489.343446:0:5783:0:(service.c:3461:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1782607489.343455:0:5783:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1782607489.395194:0:5783:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782607489.397127:0:5783:0:(service.c:3461:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1782607489.397137:0:5783:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1782607489.401614:0:5783:0:(service.c:3461:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1782607489.401640:0:5783:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1782607489.403253:0:5783:0:(service.c:3461:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1782607489.403264:0:5783:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1782607489.405304:0:5783:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1782607489.405327:0:5783:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1782607489.405333:0:5783:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.104@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1782607489.405454:0:5783:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.104@tcp ctxt 0 is initialized 00000020:01000004:1.0:1782607489.405488:0:5783:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.104@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1782607489.405493:0:5783:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1782607489.405494:0:5783:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1782607489.405495:0:5783:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782607489.405496:0:5783:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782607489.405498:0:5783:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782607489.405499:0:5783:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782607489.405500:0:5783:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782607489.405501:0:5783:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1782607489.405502:0:5783:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782607489.405503:0:5783:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782607489.405505:0:5783:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782607489.405506:0:5783:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1782607489.405509:0:5783:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1782607489.405511:0:5783:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1782607489.405511:0:5783:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1782607489.405513:0:5783:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782607489.405513:0:5783:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782607489.405514:0:5783:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782607489.405515:0:5783:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782607489.405516:0:5783:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782607489.405517:0:5783:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1782607489.405518:0:5783:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782607489.405519:0:5783:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782607489.405525:0:5783:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782607489.405526:0:5783:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1782607489.405551:0:5783:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1782607489.405569:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003e2c246d pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:5783:1869199364325632:0@lo:253: 00000100:00100000:1.0:1782607489.405666:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607489.409161:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set 000000009c0e3b1d going to sleep for 11 seconds 00000100:00100000:3.0:1782607489.409515:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364325632 00000100:00100000:3.0:1782607489.409524:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364325632 00000100:00100000:3.0:1782607489.409667:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782607489.409695:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000799483db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+5:5783:x1869199364325632:12345-0@lo:253: 20000000:01000000:3.0:1782607489.409862:0:5798:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1782607489.409865:0:5798:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1782607489.417231:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1782607489.417325:0:5798:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1782607489.417651:0:5798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782607489.419392:0:5820:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1782607489.421221:0:5798:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1782607489.421226:0:5798:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1782607489.421233:0:5798:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1782607489.421235:0:5798:0:(mgs_llog.c:3603:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1782607489.421251:0:5798:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1782607489.421500:0:5798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782607489.421744:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1782607489.421756:0:5798:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1782607489.427658:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1782607489.428964:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1782607489.429040:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1782607489.429169:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1782607489.429179:0:5798:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1782607489.429262:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1782607489.429271:0:5798:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1782607489.429301:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1782607489.429307:0:5798:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1782607489.430228:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1782607489.430322:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1782607489.430385:0:5798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1782607489.430391:0:5798:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1782607489.430406:0:5798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782607489.430599:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1782607489.430609:0:5798:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1782607489.430656:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1782607489.430692:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1782607489.430742:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1782607489.430753:0:5798:0:(mgs_llog.c:3120:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1782607489.430859:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1782607489.430869:0:5798:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1782607489.430932:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1782607489.430962:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1782607489.430988:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1782607489.430997:0:5798:0:(mgs_llog.c:3085:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1782607489.432334:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1782607489.432971:0:5798:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1782607489.433024:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1782607489.433072:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1782607489.433289:0:5798:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1782607489.433338:0:5798:0:(mgs_llog.c:3300:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1782607489.433346:0:5798:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1782607489.434752:0:5821:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1782607489.435297:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1782607489.435322:0:5798:0:(mgs_llog.c:3346:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.104@tcp for mdt 20000000:01000000:3.0:1782607489.435324:0:5798:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.202.104@tcp (null) (null) (null) 00000040:00080000:3.0:1782607489.435372:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1782607489.435380:0:5798:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1782607489.435411:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1782607489.435417:0:5798:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.104@tcp (null) (null) 00000040:00080000:3.0:1782607489.435484:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1782607489.435500:0:5798:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1782607489.435536:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1782607489.435570:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1782607489.435638:0:5798:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1782607489.435642:0:5798:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1782607489.435648:0:5798:0:(mgs_llog.c:5063:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1782607489.435655:0:5798:0:(mgs_llog.c:1376:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1782607489.436664:0:5822:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:3.0:1782607489.436975:0:5798:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1782607489.454253:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1782607489.454308:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:3.0:1782607489.454572:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:3.0:1782607489.454592:0:5798:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1782607489.454594:0:5798:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1782607489.454598:0:5798:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1782607489.454610:0:5798:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1782607489.454613:0:5798:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1782607489.454655:0:5798:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1782607489.454657:0:5798:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1782607489.456158:0:5823:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:3.0:1782607489.456445:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:3.0:1782607489.456578:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:3.0:1782607489.456654:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:3.0:1782607489.456667:0:5798:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1782607489.456669:0:5798:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1782607489.458274:0:5824:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1782607489.458674:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1782607489.458719:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1782607489.458750:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1782607489.458970:0:5798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1782607489.458973:0:5798:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:2.0:1782607489.458981:0:5798:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1782607489.459000:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004f03c16a/0x8109266df35cae31 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607489.459014:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004f03c16a/0x8109266df35cae31 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607489.459023:0:5798:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004f03c16a/0x8109266df35cae31 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607489.459093:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004f03c16a/0x8109266df35cae31 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607489.459099:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004f03c16a/0x8109266df35cae31 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607489.459120:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004f03c16a/0x8109266df35cae31 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607489.459126:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004f03c16a already unused, calling callback (000000007523438a) 00010000:00010000:2.0:1782607489.459129:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004f03c16a/0x8109266df35cae31 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607489.459136:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004f03c16a/0x8109266df35cae31 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607489.459148:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004f03c16a/0x8109266df35cae31 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607489.459154:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004f03c16a/0x8109266df35cae31 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607489.459159:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004f03c16a/0x8109266df35cae31 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1782607489.459175:0:5798:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1782607489.756324:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000799483db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+5:5783:x1869199364325632:12345-0@lo:253: Request processed in 346642us (350653us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607489.756343:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782607489.756463:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003e2c246d pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:5783:1869199364325632:0@lo:253: 10000000:01000000:0.0:1782607489.756482:0:5783:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1782607489.756485:0:5783:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782607489.756487:0:5783:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1782607489.756488:0:5783:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782607489.756489:0:5783:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1782607489.756490:0:5783:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782607489.756491:0:5783:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782607489.756493:0:5783:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1782607489.756494:0:5783:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1782607489.756496:0:5783:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1782607489.756497:0:5783:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782607489.756499:0:5783:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1782607489.756586:0:5783:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000d0285cdc from lustre-MDT0000 10000000:01000000:0.0:1782607489.756612:0:5783:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1782607489.756615:0:5783:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1782607489.756630:0:5783:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff974549e68000 10000000:01000000:0.0:1782607489.756636:0:5783:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1782607489.756644:0:5783:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff974549e68000 from 1 10000000:01000000:0.0:1782607489.756647:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1782607489.756710:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: 00000000100f59d9/0x8109266df35cae38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607489.756719:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: 00000000100f59d9/0x8109266df35cae38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607489.756728:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: 00000000100f59d9/0x8109266df35cae38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607489.756745:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004388d3e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:5783:1869199364325760:0@lo:101: 00000100:00100000:0.0:1782607489.756822:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607489.756863:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b9b4bda7 going to sleep for 11 seconds 00000100:00100000:2.0:1782607489.757041:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364325760 00000100:00100000:2.0:1782607489.757048:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364325760 00000100:00100000:0.0:1782607489.757183:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782607489.757193:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000008677d3c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+5:5783:x1869199364325760:12345-0@lo:101: 00010000:00010000:0.0:1782607489.757207:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607489.757219:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000059e0a249/0x8109266df35cae3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cae38 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607489.757239:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000059e0a249/0x8109266df35cae3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cae38 expref: 6 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607489.757248:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000059e0a249/0x8109266df35cae3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cae38 expref: 6 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607489.757255:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000059e0a249, rc 0) 00000100:00100000:0.0:1782607489.757282:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000008677d3c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+6:5783:x1869199364325760:12345-0@lo:101: Request processed in 92us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607489.757287:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782607489.757318:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004388d3e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:5783:1869199364325760:0@lo:101: 00010000:00010000:0.0:1782607489.757328:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: 00000000100f59d9/0x8109266df35cae38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cae3f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607489.757336:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: 00000000100f59d9/0x8109266df35cae38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cae3f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607489.757375:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004388d3e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:5783:1869199364325888:0@lo:501: 00000100:00100000:0.0:1782607489.757397:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607489.757409:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b9b4bda7 going to sleep for 11 seconds 00000100:00100000:2.0:1782607489.757451:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364325888 00000100:00100000:2.0:1782607489.757455:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364325888 00000100:00100000:2.0:1782607489.757483:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782607489.757488:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000daadad76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+6:5783:x1869199364325888:12345-0@lo:501: 00000100:00100000:2.0:1782607489.757860:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000daadad76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+6:5783:x1869199364325888:12345-0@lo:501: Request processed in 371us (462us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782607489.757867:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782607489.758017:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004388d3e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:5783:1869199364325888:0@lo:501: 10000000:01000000:0.0:1782607489.758040:0:5783:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1782607489.758058:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: 00000000100f59d9/0x8109266df35cae38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cae3f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607489.758066:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: 00000000100f59d9/0x8109266df35cae38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cae3f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782607489.758073:0:5783:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff974544151000 10000000:01000000:0.0:1782607489.758077:0:5783:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1782607489.758081:0:5783:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff974544151000 10000000:01000000:0.0:1782607489.758083:0:5783:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1782607489.758085:0:5783:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff974544151000 from 1 10000000:01000000:0.0:1782607489.758087:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1782607489.758174:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: 0000000015f963fe/0x8109266df35cae46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607489.758181:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: 0000000015f963fe/0x8109266df35cae46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607489.758188:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: 0000000015f963fe/0x8109266df35cae46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607489.758199:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004388d3e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:5783:1869199364326016:0@lo:101: 00000100:00100000:0.0:1782607489.758224:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607489.758244:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b9b4bda7 going to sleep for 11 seconds 00000100:00100000:0.0:1782607489.758257:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364326016 00000100:00100000:0.0:1782607489.758260:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364326016 00000100:00100000:0.0:1782607489.758278:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782607489.758283:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000ff344693 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+6:5783:x1869199364326016:12345-0@lo:101: 00010000:00010000:0.0:1782607489.758297:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607489.758305:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b1a30250/0x8109266df35cae4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cae46 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607489.758319:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b1a30250/0x8109266df35cae4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cae46 expref: 7 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607489.758327:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b1a30250/0x8109266df35cae4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cae46 expref: 7 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607489.758333:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b1a30250, rc 0) 00000100:00100000:0.0:1782607489.758357:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000ff344693 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+7:5783:x1869199364326016:12345-0@lo:101: Request processed in 74us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607489.758362:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782607489.758387:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004388d3e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:5783:1869199364326016:0@lo:101: 00010000:00010000:0.0:1782607489.758395:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: 0000000015f963fe/0x8109266df35cae46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cae4d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607489.758401:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: 0000000015f963fe/0x8109266df35cae46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cae4d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782607489.758411:0:5783:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1782607489.758414:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: 0000000015f963fe/0x8109266df35cae46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cae4d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607489.758419:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: 0000000015f963fe/0x8109266df35cae46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cae4d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782607489.758424:0:5783:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1782607489.758431:0:5783:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1782607489.758435:0:5783:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff974544151000 10000000:01000000:0.0:1782607489.758437:0:5783:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1782607489.758440:0:5783:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1782607489.758442:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1782607489.758453:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: 000000001dcfab44/0x8109266df35cae54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607489.758459:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: 000000001dcfab44/0x8109266df35cae54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607489.758465:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: 000000001dcfab44/0x8109266df35cae54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607489.758475:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004388d3e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:5783:1869199364326144:0@lo:101: 00000100:00100000:0.0:1782607489.758497:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607489.758596:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ef57904f going to sleep for 11 seconds 00000100:00100000:2.0:1782607489.758702:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364326144 00000100:00100000:2.0:1782607489.758706:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364326144 00000100:00100000:2.0:1782607489.758724:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782607489.758730:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000101283d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+7:5783:x1869199364326144:12345-0@lo:101: 00010000:00010000:2.0:1782607489.758736:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607489.758743:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004f03c16a/0x8109266df35cae5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cae54 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607489.758756:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004f03c16a/0x8109266df35cae5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cae54 expref: 8 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607489.758878:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004f03c16a/0x8109266df35cae5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cae54 expref: 8 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607489.759204:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004f03c16a, rc 0) 00000100:00100000:2.0:1782607489.759247:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000101283d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+8:5783:x1869199364326144:12345-0@lo:101: Request processed in 518us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607489.759253:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782607489.759382:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004388d3e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:5783:1869199364326144:0@lo:101: 00010000:00010000:1.0:1782607489.759392:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: 000000001dcfab44/0x8109266df35cae54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cae5b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607489.759399:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: 000000001dcfab44/0x8109266df35cae54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cae5b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607489.759442:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001456aa72 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:5783:1869199364326272:0@lo:501: 00000100:00100000:1.0:1782607489.759466:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607489.759492:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set 000000009fd172e9 going to sleep for 11 seconds 00000100:00100000:2.0:1782607489.759604:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364326272 00000100:00100000:2.0:1782607489.759609:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364326272 00000100:00100000:2.0:1782607489.759650:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782607489.759656:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000008bbc0ec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+8:5783:x1869199364326272:12345-0@lo:501: 00000100:00100000:1.0:1782607489.760082:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001456aa72 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:5783:1869199364326272:0@lo:501: 00000100:00100000:1.0:1782607489.760187:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001456aa72 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:5783:1869199364326400:0@lo:503: 00000100:00100000:1.0:1782607489.760306:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607489.760368:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set 000000009fd172e9 going to sleep for 11 seconds 00000100:00100000:2.0:1782607489.760410:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000008bbc0ec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+9:5783:x1869199364326272:12345-0@lo:501: Request processed in 754us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607489.760418:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782607489.760445:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364326400 00000100:00100000:2.0:1782607489.760450:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364326400 00000100:00100000:0.0:1782607489.760489:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782607489.760496:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000a222c6a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+9:5783:x1869199364326400:12345-0@lo:503: 00000100:00100000:0.0:1782607489.763341:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000a222c6a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+9:5783:x1869199364326400:12345-0@lo:503: Request processed in 2838us (3028us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607489.763369:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782607489.763684:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001456aa72 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:5783:1869199364326400:0@lo:503: 00000100:00100000:1.0:1782607489.763937:0:5826:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001456aa72 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:5826:1869199364326528:0@lo:502: 00000100:00100000:1.0:1782607489.763985:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607489.764892:0:5826:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ac1a2e05 going to sleep for 11 seconds 00000100:00100000:3.0:1782607489.765228:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364326528 00000100:00100000:3.0:1782607489.765237:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364326528 00000100:00100000:3.0:1782607489.765296:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782607489.765304:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000b1e4823a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+9:5826:x1869199364326528:12345-0@lo:502: 00000100:00100000:3.0:1782607489.765546:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000b1e4823a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+9:5826:x1869199364326528:12345-0@lo:502: Request processed in 243us (1561us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607489.765563:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782607489.765741:0:5826:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001456aa72 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:5826:1869199364326528:0@lo:502: 00000020:01000000:1.0:1782607489.765788:0:5826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782607489.765800:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782607489.765802:0:5826:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1782607489.765808:0:5826:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1782607489.765811:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782607489.765826:0:5826:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000000e128904) 00000020:00000080:1.0:1782607489.765844:0:5826:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1782607489.765849:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1782607489.765952:0:5826:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:1.0:1782607489.765958:0:5826:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8109266df35cae69 00000020:00000080:1.0:1782607489.766398:0:5826:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1782607489.766403:0:5826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782607489.766407:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782607489.766409:0:5826:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1782607489.766412:0:5826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782607489.766416:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782607489.766417:0:5826:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1782607489.766420:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782607489.766437:0:5826:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000a0003f40) 00000020:00000080:1.0:1782607489.766448:0:5826:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1782607489.766453:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1782607489.766455:0:5826:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1782607489.766458:0:5826:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1782607489.766464:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1782607489.766572:0:5826:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d0285cdc from lustre-MDT0000, refs=3 00000020:00000080:1.0:1782607489.766584:0:5826:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000ec236041) 00000020:00000080:1.0:1782607489.766592:0:5826:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1782607489.766649:0:5826:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1782607489.766655:0:5826:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8109266df35cae7e 00000020:00000080:1.0:1782607489.766800:0:5826:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1782607489.766806:0:5826:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1782607489.766816:0:5826:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x8109266df35cae85 00080000:01000000:1.0:1782607489.766820:0:5826:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:1.0:1782607489.766823:0:5826:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8109266df35cae8c 00080000:10000000:1.0:1782607489.767343:0:5826:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1782607489.767579:0:5826:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1782607489.772501:0:5826:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1782607489.842429:0:5826:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1782607489.843143:0:5826:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1782607489.846233:0:5826:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1782607489.846649:0:5826:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1782607489.874264:0:5826:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000d18b46d3) 00000020:00000080:3.0:1782607489.874292:0:5826:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1782607489.874359:0:5826:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:3.0:1782607489.874367:0:5826:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8109266df35cae9a 00000020:00000080:0.0:1782607489.883299:0:5826:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1782607489.886088:0:5826:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1782607489.947277:0:5826:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1782607489.980672:0:5826:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1782607490.011799:0:5826:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1782607490.054681:0:5826:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1782607490.084657:0:5826:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1782607490.109418:0:5826:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x8109266df35caea1 00000020:00000080:2.0:1782607490.110186:0:5826:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1782607490.110200:0:5826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782607490.110206:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782607490.110209:0:5826:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1782607490.110211:0:5826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782607490.110217:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782607490.110218:0:5826:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1782607490.110221:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1782607490.110258:0:5826:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1782607490.110274:0:5826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782607490.110277:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782607490.110278:0:5826:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1782607490.110280:0:5826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782607490.110282:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782607490.110283:0:5826:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1782607490.110285:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1782607490.110286:0:5826:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1782607490.110333:0:5826:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000000eba4bfe pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:5826:1869199364326656:0@lo:502: 00000100:00100000:2.0:1782607490.110404:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607490.110629:0:5826:0:(client.c:2701:ptlrpc_set_wait()) set 000000007b18578c going to sleep for 11 seconds 00000100:00100000:0.0:1782607490.110729:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364326656 00000100:00100000:0.0:1782607490.110737:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364326656 00000100:00100000:0.0:1782607490.110885:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782607490.110893:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000046bf416e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+9:5826:x1869199364326656:12345-0@lo:502: 00000100:00100000:0.0:1782607490.111338:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000046bf416e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+9:5826:x1869199364326656:12345-0@lo:502: Request processed in 446us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607490.111347:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782607490.111428:0:5826:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000000eba4bfe pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:5826:1869199364326656:0@lo:502: 00000020:01000000:1.0:1782607490.111456:0:5826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782607490.111461:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782607490.111563:0:5826:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:1.0:1782607490.111569:0:5826:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1782607490.111755:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1782607490.111923:0:5783:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1782607490.111962:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: 000000001dcfab44/0x8109266df35cae54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cae5b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607490.111985:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: 000000001dcfab44/0x8109266df35cae54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cae5b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782607490.111992:0:5783:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff974544151000 from 1 10000000:01000000:2.0:1782607490.111994:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782607490.112021:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: 0000000049b30c71/0x8109266df35caea8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607490.112027:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: 0000000049b30c71/0x8109266df35caea8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607490.112035:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: 0000000049b30c71/0x8109266df35caea8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607490.112049:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000000f2c4aaa pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:5783:1869199364326784:0@lo:101: 00000100:00100000:2.0:1782607490.112079:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607490.112110:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set 00000000aafe351c going to sleep for 11 seconds 00000100:00100000:0.0:1782607490.112166:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364326784 00000100:00100000:0.0:1782607490.112171:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364326784 00000100:00100000:0.0:1782607490.112201:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782607490.112207:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000341fcb37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+9:5783:x1869199364326784:12345-0@lo:101: 00010000:00010000:0.0:1782607490.112217:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607490.112230:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b3989341/0x8109266df35caeaf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35caea8 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607490.112250:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b3989341/0x8109266df35caeaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35caea8 expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607490.112259:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b3989341/0x8109266df35caeaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35caea8 expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607490.112268:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b3989341, rc 0) 00000100:00100000:0.0:1782607490.112293:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000341fcb37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+10:5783:x1869199364326784:12345-0@lo:101: Request processed in 86us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607490.112298:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782607490.112377:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000000f2c4aaa pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:5783:1869199364326784:0@lo:101: 00010000:00010000:2.0:1782607490.112389:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: 0000000049b30c71/0x8109266df35caea8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35caeaf expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607490.112396:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: 0000000049b30c71/0x8109266df35caea8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35caeaf expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607490.113012:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000000f2c4aaa pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:5783:1869199364326912:0@lo:256: 00000100:00100000:2.0:1782607490.113050:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607490.113074:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set 00000000aafe351c going to sleep for 11 seconds 00000100:00100000:0.0:1782607490.113198:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364326912 00000100:00100000:0.0:1782607490.113203:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364326912 00000100:00100000:0.0:1782607490.113237:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782607490.113244:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000d01db3b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+10:5783:x1869199364326912:12345-0@lo:256: 20000000:01000000:0.0:1782607490.113263:0:5798:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1782607490.113269:0:5798:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1782607490.113325:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000d01db3b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+10:5783:x1869199364326912:12345-0@lo:256: Request processed in 83us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607490.113333:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782607490.113416:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000000f2c4aaa pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:5783:1869199364326912:0@lo:256: 10000000:01000000:2.0:1782607490.114269:0:5783:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1782607490.114583:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: 0000000049b30c71/0x8109266df35caea8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35caeaf expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607490.114595:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: 0000000049b30c71/0x8109266df35caea8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35caeaf expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782607490.114669:0:5783:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff974544151000 from 1 10000000:01000000:0.0:1782607490.114674:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782607490.114711:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: 00000000908c771a/0x8109266df35caeb6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607490.114720:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: 00000000908c771a/0x8109266df35caeb6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607490.114729:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: 00000000908c771a/0x8109266df35caeb6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607490.114747:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d7d0aa01 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:5783:1869199364327040:0@lo:101: 00000100:00100000:0.0:1782607490.114821:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607490.114851:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set 00000000cce3c3f1 going to sleep for 11 seconds 00000100:00100000:2.0:1782607490.114936:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364327040 00000100:00100000:2.0:1782607490.114941:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364327040 00000100:00100000:2.0:1782607490.114980:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782607490.114987:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000003259774d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+10:5783:x1869199364327040:12345-0@lo:101: 00010000:00010000:2.0:1782607490.114998:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607490.115011:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000fa915ac/0x8109266df35caebd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35caeb6 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607490.115031:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000fa915ac/0x8109266df35caebd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35caeb6 expref: 11 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607490.115041:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000fa915ac/0x8109266df35caebd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35caeb6 expref: 11 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607490.115049:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000fa915ac, rc 0) 00000100:00100000:2.0:1782607490.115079:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000003259774d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+11:5783:x1869199364327040:12345-0@lo:101: Request processed in 93us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607490.115085:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782607490.115174:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d7d0aa01 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:5783:1869199364327040:0@lo:101: 00010000:00010000:0.0:1782607490.115185:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: 00000000908c771a/0x8109266df35caeb6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35caebd expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607490.115192:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: 00000000908c771a/0x8109266df35caeb6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35caebd expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607490.115234:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d7d0aa01 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:5783:1869199364327168:0@lo:501: 00000100:00100000:0.0:1782607490.115255:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607490.115288:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set 00000000cce3c3f1 going to sleep for 11 seconds 00000100:00100000:2.0:1782607490.115336:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364327168 00000100:00100000:2.0:1782607490.115340:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364327168 00000100:00100000:2.0:1782607490.115365:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782607490.115376:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000031f86c31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+11:5783:x1869199364327168:12345-0@lo:501: 00000100:00100000:2.0:1782607490.116193:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000031f86c31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+11:5783:x1869199364327168:12345-0@lo:501: Request processed in 816us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607490.116200:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782607490.116657:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d7d0aa01 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:5783:1869199364327168:0@lo:501: 00000100:00100000:0.0:1782607490.116697:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d7d0aa01 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:5783:1869199364327296:0@lo:503: 00000100:00100000:0.0:1782607490.116739:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607490.116939:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set 00000000cce3c3f1 going to sleep for 11 seconds 00000100:00100000:3.0:1782607490.116982:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364327296 00000100:00100000:3.0:1782607490.116987:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364327296 00000100:00100000:3.0:1782607490.117028:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782607490.117035:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000071cf477d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+11:5783:x1869199364327296:12345-0@lo:503: 00000040:00080000:3.0:1782607490.117078:0:5798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782607490.117201:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000071cf477d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+11:5783:x1869199364327296:12345-0@lo:503: Request processed in 167us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607490.117209:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782607490.117297:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d7d0aa01 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:5783:1869199364327296:0@lo:503: 00000040:00080000:1.0:1782607490.118416:0:5830:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1782607490.118759:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1782607490.118877:0:5783:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782607490.118931:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: 00000000908c771a/0x8109266df35caeb6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35caebd expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607490.118943:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: 00000000908c771a/0x8109266df35caeb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35caebd expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782607490.118989:0:5783:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1782607490.118992:0:5783:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff974544151000 10000000:01000000:2.0:1782607490.118995:0:5783:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff974544151000 10000000:01000000:2.0:1782607490.119000:0:5783:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782607490.119006:0:5783:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff974544151000 from 1 10000000:01000000:2.0:1782607490.119008:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782607490.119043:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: 00000000b7aeaff3/0x8109266df35caec4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607490.119050:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: 00000000b7aeaff3/0x8109266df35caec4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607490.119060:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: 00000000b7aeaff3/0x8109266df35caec4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607490.119079:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000000f2c4aaa pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:5783:1869199364327424:0@lo:101: 00000100:00100000:2.0:1782607490.119146:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607490.119187:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set 0000000011151612 going to sleep for 11 seconds 00000100:00100000:0.0:1782607490.119231:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364327424 00000100:00100000:0.0:1782607490.119237:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364327424 00000100:00100000:0.0:1782607490.119279:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782607490.119286:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000a747e7a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+11:5783:x1869199364327424:12345-0@lo:101: 00010000:00010000:0.0:1782607490.119298:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607490.119308:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000658f54a9/0x8109266df35caecb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35caec4 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607490.119328:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000658f54a9/0x8109266df35caecb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35caec4 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607490.119337:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000658f54a9/0x8109266df35caecb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35caec4 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607490.119346:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000658f54a9, rc 0) 00000100:00100000:0.0:1782607490.119389:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000a747e7a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+12:5783:x1869199364327424:12345-0@lo:101: Request processed in 104us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607490.119395:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782607490.119577:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000000f2c4aaa pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:5783:1869199364327424:0@lo:101: 00010000:00010000:3.0:1782607490.119595:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: 00000000b7aeaff3/0x8109266df35caec4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35caecb expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607490.119604:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: 00000000b7aeaff3/0x8109266df35caec4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35caecb expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607490.119675:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000000f9ac91f pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:5783:1869199364327552:0@lo:501: 00000100:00100000:3.0:1782607490.119701:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607490.119723:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e6ce4279 going to sleep for 11 seconds 00000100:00100000:0.0:1782607490.119871:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364327552 00000100:00100000:0.0:1782607490.119876:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364327552 00000100:00100000:0.0:1782607490.119906:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782607490.119911:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000006680a154 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+12:5783:x1869199364327552:12345-0@lo:501: 00000100:00100000:0.0:1782607490.120147:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000006680a154 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+12:5783:x1869199364327552:12345-0@lo:501: Request processed in 235us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607490.120160:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782607490.120256:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000000f9ac91f pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:5783:1869199364327552:0@lo:501: 00000100:00100000:3.0:1782607490.120286:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000000f9ac91f pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:5783:1869199364327680:0@lo:503: 00000100:00100000:3.0:1782607490.120322:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607490.120354:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e6ce4279 going to sleep for 11 seconds 00000100:00100000:2.0:1782607490.120401:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364327680 00000100:00100000:2.0:1782607490.120405:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364327680 00000100:00100000:2.0:1782607490.120432:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782607490.120437:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000be84a67f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+12:5783:x1869199364327680:12345-0@lo:503: 00000100:00100000:2.0:1782607490.120785:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000be84a67f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+12:5783:x1869199364327680:12345-0@lo:503: Request processed in 326us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607490.120792:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782607490.120921:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000000f9ac91f pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:5783:1869199364327680:0@lo:503: 00000100:00100000:3.0:1782607490.121348:0:5831:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000000f9ac91f pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:5831:1869199364327808:0@lo:502: 00000100:00100000:3.0:1782607490.121382:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607490.121407:0:5831:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a9a06ba5 going to sleep for 11 seconds 00000100:00100000:2.0:1782607490.121445:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364327808 00000100:00100000:2.0:1782607490.121449:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364327808 00000100:00100000:2.0:1782607490.121482:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782607490.121487:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000088cb0af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+12:5831:x1869199364327808:12345-0@lo:502: 00000100:00100000:2.0:1782607490.121894:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000088cb0af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+12:5831:x1869199364327808:12345-0@lo:502: Request processed in 406us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607490.121902:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782607490.122022:0:5831:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000000f9ac91f pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:5831:1869199364327808:0@lo:502: 00000020:01000004:3.0:1782607490.122077:0:5831:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1782607490.122090:0:5831:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000ac39b47d) 00000020:00000080:3.0:1782607490.122108:0:5831:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1782607490.122315:0:5831:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d0285cdc from lustre-MDT0000, refs=4 00000020:01000004:3.0:1782607490.122320:0:5831:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000d0285cdc from lustre-MDT0000, refs=4 00000020:01000004:3.0:1782607490.122322:0:5831:0:(obd_mount.c:701:lustre_put_lsi()) put 00000000d0285cdc 4 00010000:00080000:3.0:1782607490.122348:0:5831:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000031941c96@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.104@tcp at head 00010000:00010000:3.0:1782607490.124400:0:5831:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1782607490.124635:0:5831:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1782607490.124671:0:5831:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1782607490.124683:0:5831:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x8109266df35caed9 00000100:00080000:3.0:1782607490.124693:0:5831:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782607490.124698:0:5831:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000031941c96 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1782607490.124731:0:5831:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000f9ac91f x1869199364327936/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782607490.124785:0:5831:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1782607490.125052:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000000f9ac91f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869199364327936:0@lo:38: 00000100:00100000:2.0:1782607490.125123:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607490.125217:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364327936 00000100:00100000:1.0:1782607490.125223:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364327936 00000100:00100000:1.0:1782607490.125258:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782607490.125264:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000419e321e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3315:x1869199364327936:12345-0@lo:38: 00000100:00100000:1.0:1782607490.125313:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000419e321e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3315:x1869199364327936:12345-0@lo:38: Request processed in 49us (192us total) trans 0 rc -11/-11 00000100:00100000:1.0:1782607490.125320:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782607490.125351:0:3315:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1782607490.125358:0:3315:0:(import.c:65:import_set_state_nolock()) 0000000031941c96 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782607490.125362:0:3315:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1782607490.125365:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000000f9ac91f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869199364327936:0@lo:38: 00000100:00100000:3.0:1782607490.125481:0:5831:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004e7a3afc pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:5831:1869199364328064:0@lo:502: 00000100:00100000:3.0:1782607490.125709:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607490.125798:0:5831:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a4557f14 going to sleep for 11 seconds 00000100:00100000:1.0:1782607490.128448:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364328064 00000100:00100000:1.0:1782607490.128460:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364328064 00000100:00100000:1.0:1782607490.128702:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782607490.128712:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000003513b35d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+12:5831:x1869199364328064:12345-0@lo:502: 00000100:00100000:1.0:1782607490.129034:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000003513b35d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+12:5831:x1869199364328064:12345-0@lo:502: Request processed in 324us (3325us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607490.129049:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782607490.129207:0:5831:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004e7a3afc pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:5831:1869199364328064:0@lo:502: 00000040:00080000:2.0:1782607490.129246:0:5831:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1782607490.129330:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1782607490.129347:0:5783:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782607490.129358:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: 00000000b7aeaff3/0x8109266df35caec4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35caecb expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607490.129368:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: 00000000b7aeaff3/0x8109266df35caec4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35caecb expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1782607490.129428:0:5783:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1782607490.129430:0:5783:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782607490.129431:0:5783:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782607490.129432:0:5783:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782607490.129433:0:5783:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782607490.129434:0:5783:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782607490.129436:0:5783:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782607490.129438:0:5783:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782607490.129439:0:5783:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782607490.129440:0:5783:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782607490.129442:0:5783:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782607490.129443:0:5783:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782607490.129446:0:5783:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1782607490.129449:0:5783:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782607490.129450:0:5783:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782607490.129451:0:5783:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782607490.129452:0:5783:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782607490.129453:0:5783:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782607490.129454:0:5783:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782607490.129455:0:5783:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782607490.129456:0:5783:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782607490.129457:0:5783:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782607490.129458:0:5783:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782607490.129459:0:5783:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782607490.129459:0:5783:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782607490.129491:0:5783:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1782607490.129512:0:5783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e381bd47 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:5783:1869199364328192:0@lo:253: 00000100:00100000:2.0:1782607490.129558:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607490.129588:0:5783:0:(client.c:2701:ptlrpc_set_wait()) set 000000003f348db8 going to sleep for 11 seconds 00000100:00100000:2.0:1782607490.129603:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364328192 00000100:00100000:2.0:1782607490.129608:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364328192 00000100:00100000:2.0:1782607490.129645:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782607490.129652:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000004e91ee38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+12:5783:x1869199364328192:12345-0@lo:253: 20000000:01000000:2.0:1782607490.129672:0:5797:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1782607490.129691:0:5797:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1782607490.161118:0:5797:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1782607490.161140:0:5797:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1782607490.161229:0:5819:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1782607490.161234:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1782607490.161269:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006500af02/0x8109266df35caee0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607490.161290:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b3989341/0x8109266df35caeaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35caea8 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607490.161299:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000006500af02/0x8109266df35caee0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607490.161339:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b3989341/0x8109266df35caeaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8109266df35caea8 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607490.161353:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b3989341/0x8109266df35caeaf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8109266df35caea8 expref: 12 pid: 5797 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607490.161367:0:5819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000079e33a9 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5819:1869199364328320:0@lo:104: 00000100:00100000:3.0:1782607490.161434:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607490.161483:0:5819:0:(client.c:2701:ptlrpc_set_wait()) set 00000000cb065202 going to sleep for 11 seconds 00000100:00100000:2.0:1782607490.161652:0:5785:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364328320 00000100:00100000:2.0:1782607490.161660:0:5785:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364328320 00000100:00100000:2.0:1782607490.161709:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782607490.161717:0:5785:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000004e5c9223 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+3:5819:x1869199364328320:12345-0@lo:104: 00010000:00010000:2.0:1782607490.161729:0:5785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: 0000000049b30c71/0x8109266df35caea8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35caeaf expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607490.161804:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782607490.161809:0:5785:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000004e5c9223 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+3:5819:x1869199364328320:12345-0@lo:104: Request processed in 93us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607490.161816:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1782607490.161838:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782607490.161843:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: 0000000049b30c71/0x8109266df35caea8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35caeaf expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607490.161850:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000049b30c71 already unused, calling callback (00000000458cbea2) 10000000:00010000:2.0:1782607490.161853:0:5790:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: 0000000049b30c71/0x8109266df35caea8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8109266df35caeaf expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607490.161860:0:5790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: 0000000049b30c71/0x8109266df35caea8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8109266df35caeaf expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782607490.161866:0:5790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: 0000000049b30c71/0x8109266df35caea8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8109266df35caeaf expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782607490.161870:0:5790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1782607490.161898:0:5790:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: 0000000049b30c71/0x8109266df35caea8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35caeaf expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607490.161904:0:5790:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782607490.161929:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: 0000000049b30c71/0x8109266df35caea8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35caeaf expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607490.161935:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: 0000000049b30c71/0x8109266df35caea8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35caeaf expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607490.161959:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607490.161961:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607490.161963:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782607490.162058:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000695745ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fae11c6e-4506-4104-bb8c-df42498f7e08:3317:1869199364328448:0@lo:103: 00000100:00100000:2.0:1782607490.162089:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607490.162161:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364328448 00000100:00100000:2.0:1782607490.162165:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364328448 00010000:00010000:2.0:1782607490.162182:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b3989341/0x8109266df35caeaf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35caea8 expref: 13 pid: 5797 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607490.162201:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782607490.162206:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000070aefa13 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+13:3317:x1869199364328448:12345-0@lo:103: 00010000:00010000:2.0:1782607490.162214:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782607490.162218:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b3989341/0x8109266df35caeaf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35caea8 expref: 13 pid: 5797 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607490.162226:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b3989341/0x8109266df35caeaf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8109266df35caea8 expref: 13 pid: 5797 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607490.162240:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000006500af02/0x8109266df35caee0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607490.162246:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006500af02/0x8109266df35caee0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1782607490.162268:0:5787:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001035222s 00010000:00010000:2.0:1782607490.162272:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006500af02/0x8109266df35caee0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607490.162278:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006500af02/0x8109266df35caee0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607490.162282:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006500af02/0x8109266df35caee0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607490.162288:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006500af02/0x8109266df35caee0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607490.162292:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006500af02 already unused, calling callback (000000007523438a) 00010000:00010000:2.0:1782607490.162295:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006500af02/0x8109266df35caee0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607490.162302:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006500af02/0x8109266df35caee0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607490.162308:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006500af02/0x8109266df35caee0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607490.162317:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782607490.162344:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000070aefa13 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+13:3317:x1869199364328448:12345-0@lo:103: Request processed in 138us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607490.162351:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782607490.162383:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000695745ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fae11c6e-4506-4104-bb8c-df42498f7e08:3317:1869199364328448:0@lo:103: 00010000:00010000:2.0:1782607490.162416:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b3989341/0x8109266df35caeaf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8109266df35caea8 expref: 12 pid: 5797 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607490.162433:0:5819:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000079e33a9 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5819:1869199364328320:0@lo:104: 00010000:00010000:2.0:1782607490.162448:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000006500af02/0x8109266df35caee0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607490.162456:0:5819:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000006500af02/0x8109266df35caee0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607490.162461:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006500af02/0x8109266df35caee0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607490.162466:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006500af02/0x8109266df35caee0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607490.170353:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000004e91ee38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+11:5783:x1869199364328192:12345-0@lo:253: Request processed in 40695us (40788us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607490.170369:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782607490.170493:0:5783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e381bd47 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:5783:1869199364328192:0@lo:253: 10000000:01000000:2.0:1782607490.170518:0:5783:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1782607490.170521:0:5783:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782607490.170523:0:5783:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782607490.170525:0:5783:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782607490.170526:0:5783:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782607490.170527:0:5783:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782607490.170528:0:5783:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782607490.170529:0:5783:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782607490.170530:0:5783:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782607490.170532:0:5783:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782607490.170533:0:5783:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782607490.170535:0:5783:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782607490.170536:0:5783:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1782607490.170552:0:5783:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1782607490.184601:0:5783:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1782607490.185091:0:5783:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1782607490.185311:0:5783:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1782607490.185489:0:5783:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1782607490.186118:0:5783:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1782607490.186301:0:5783:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1782607490.187170:0:5783:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1782607490.187354:0:5783:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1782607490.187658:0:5783:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1782607490.187874:0:5783:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1782607490.188110:0:5783:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1782607490.188296:0:5783:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1782607490.223445:0:5783:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00010000:00010000:0.0:1782607490.243791:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1782607490.263255:0:5783:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1782607490.263416:0:5836:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1782607490.263420:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1782607490.263681:0:5837:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1782607490.266656:0:5783:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1782607490.266875:0:5783:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1782607490.267334:0:5783:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1782607490.267342:0:5783:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1782607490.267491:0:5783:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782607490.271112:0:5783:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1782607490.271700:0:5783:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1782607490.271734:0:5783:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1782607490.272182:0:5783:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1782607490.272414:0:5783:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1782607490.276975:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1782607490.277256:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1782607490.277407:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1782607490.278822:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1782607490.279001:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1782607490.279217:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1782607490.279353:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1782607490.279496:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1782607490.280111:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1782607490.280260:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1782607490.280397:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1782607490.280641:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1782607490.280822:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1782607490.280975:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1782607490.281122:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1782607490.281291:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1782607490.281754:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1782607490.281933:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1782607490.282074:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1782607490.282234:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1782607490.282379:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1782607490.282928:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1782607490.283103:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1782607490.283242:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1782607490.283382:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1782607490.283925:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1782607490.284078:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1782607490.284240:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1782607490.284390:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1782607490.284679:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1782607490.284895:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1782607490.285073:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1782607490.285269:0:5783:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1782607490.312599:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1782607490.355127:0:5783:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1782607490.355164:0:5783:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffba98c16b7988 00100000:10000000:3.0:1782607490.355173:0:5783:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1782607490.355805:0:5783:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1782607490.355821:0:5783:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.104@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1782607490.355835:0:5783:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1782607490.355860:0:5783:0:(super25.c:188:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1782607490.360326:0:5837:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1782607490.360401:0:5837:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1782607490.360405:0:5837:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1782607491.266464:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607492.291474:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607493.319078:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607494.349565:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782607495.064003:0:6079:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1782607495.233977:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1782607495.233989:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1782607495.233992:0:36:0:(import.c:65:import_set_state_nolock()) 0000000031941c96 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782607495.234005:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000031941c96 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1782607495.234030:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000508b6ee3 x1869199364328704/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782607495.234068:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000508b6ee3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869199364328704:0@lo:38: 00000100:00100000:3.0:1782607495.234184:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607495.234354:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000dcf4c580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fae11c6e-4506-4104-bb8c-df42498f7e08:3318:1869199364328576:0@lo:400: 00000100:00100000:0.0:1782607495.234406:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607495.234469:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364328704 00000100:00100000:0.0:1782607495.234476:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364328704 00000100:00100000:0.0:1782607495.234517:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782607495.234524:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000416c4b90 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3315:x1869199364328704:12345-0@lo:38: 00010000:00080000:0.0:1782607495.234548:0:5805:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 154 last 0 00000020:00000080:0.0:1782607495.234593:0:5805:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x8109266df35caee7 00000004:00100000:0.0:1782607495.234633:0:5805:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1782607495.234761:0:5805:0:(import.c:65:import_set_state_nolock()) 0000000056a4f95f : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782607495.234835:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000416c4b90 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869199364328704:12345-0@lo:38: Request processed in 310us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607495.234843:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1782607495.234889:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000508b6ee3 x1869199364328704/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782607505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1782607495.234903:0:3315:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1782607495.234910:0:3315:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1782607495.234915:0:3315:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1782607495.234925:0:3315:0:(import.c:65:import_set_state_nolock()) 0000000031941c96 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1782607495.234930:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000508b6ee3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869199364328704:0@lo:38: 00000100:00100000:3.0:1782607495.235074:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364328576 00000100:00100000:3.0:1782607495.235079:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364328576 00000100:00100000:3.0:1782607495.235120:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782607495.235126:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000f467c952 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+11:3318:x1869199364328576:12345-0@lo:400: 00000100:00100000:3.0:1782607495.235162:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000f467c952 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+11:3318:x1869199364328576:12345-0@lo:400: Request processed in 36us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607495.235168:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782607495.235243:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000dcf4c580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fae11c6e-4506-4104-bb8c-df42498f7e08:3318:1869199364328576:0@lo:400: 00010000:00010000:2.0:1782607495.363537:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782607495.751465:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1782607495.751473:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff974544151000 from 3 10000000:01000000:1.0:1782607495.751478:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782607495.751916:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: 00000000e3426bfe/0x8109266df35caeee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607495.751929:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: 00000000e3426bfe/0x8109266df35caeee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607495.751939:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: 00000000e3426bfe/0x8109266df35caeee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607495.751961:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001456aa72 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364328832:0@lo:101: 00000100:00100000:1.0:1782607495.752028:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607495.752129:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364328832 00000100:00100000:2.0:1782607495.752136:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364328832 00000100:00100000:2.0:1782607495.752186:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782607495.752194:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000005359f717 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+11:5800:x1869199364328832:12345-0@lo:101: 00010000:00010000:2.0:1782607495.752210:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607495.752222:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d6172316/0x8109266df35caef5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35caeee expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607495.752243:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d6172316/0x8109266df35caef5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35caeee expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607495.752282:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d6172316/0x8109266df35caef5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35caeee expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607495.752291:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d6172316, rc 0) 00000100:00100000:2.0:1782607495.754226:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000005359f717 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+12:5800:x1869199364328832:12345-0@lo:101: Request processed in 2028us (2194us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607495.754238:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782607495.755477:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set 00000000104b59bf going to sleep for 11 seconds 00000100:00100000:1.0:1782607495.755522:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001456aa72 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364328832:0@lo:101: 00010000:00010000:1.0:1782607495.755546:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: 00000000e3426bfe/0x8109266df35caeee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35caef5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607495.755557:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: 00000000e3426bfe/0x8109266df35caeee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35caef5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607495.755643:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001456aa72 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364328960:0@lo:256: 00000100:00100000:1.0:1782607495.755699:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607495.755726:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set 00000000104b59bf going to sleep for 11 seconds 00000100:00100000:0.0:1782607495.755962:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364328960 00000100:00100000:0.0:1782607495.755969:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364328960 00000100:00100000:0.0:1782607495.756015:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782607495.756023:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000a382115c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+12:5800:x1869199364328960:12345-0@lo:256: 20000000:01000000:0.0:1782607495.756045:0:5795:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1782607495.756067:0:5795:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1782607495.756070:0:5795:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1782607495.756151:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000a382115c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+12:5800:x1869199364328960:12345-0@lo:256: Request processed in 129us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607495.756159:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782607495.756829:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001456aa72 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364328960:0@lo:256: 10000000:01000000:1.0:1782607495.756879:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1782607495.756886:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: 00000000e3426bfe/0x8109266df35caeee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35caef5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607495.756895:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: 00000000e3426bfe/0x8109266df35caeee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35caef5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607496.388807:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607497.414263:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607498.448183:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607499.463173:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782607500.322152:0:6281:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd2d66ce70 20000000:00000080:3.0:1782607500.322171:0:6281:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9745710ab400 uarg=0000000000000000 20000000:01000000:3.0:1782607500.322208:0:6281:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1782607500.322216:0:6281:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1782607500.322226:0:6281:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1782607500.322473:0:6281:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1782607500.322485:0:6281:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1782607500.330346:0:6281:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782607500.330658:0:6281:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1782607500.330715:0:6281:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1782607500.330760:0:6281:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1782607500.330987:0:6281:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1782607500.331006:0:6281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006500af02/0x8109266df35caefc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607500.331023:0:6281:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000fa915ac/0x8109266df35caebd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35caeb6 expref: 11 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607500.331030:0:6281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000006500af02/0x8109266df35caefc lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607500.331069:0:6281:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000fa915ac/0x8109266df35caebd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8109266df35caeb6 expref: 11 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607500.331083:0:6281:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000fa915ac/0x8109266df35caebd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8109266df35caeb6 expref: 11 pid: 5795 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607500.331097:0:6281:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007e6db4a1 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6281:1869199364329088:0@lo:104: 00000100:00100000:3.0:1782607500.331159:0:6281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607500.331217:0:6281:0:(client.c:2701:ptlrpc_set_wait()) set 00000000bfdbf90f going to sleep for 11 seconds 00000100:00100000:2.0:1782607500.331587:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364329088 00000100:00100000:2.0:1782607500.331594:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364329088 00000100:00100000:2.0:1782607500.331653:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782607500.331663:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000e8976d5b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+3:6281:x1869199364329088:12345-0@lo:104: 00010000:00010000:2.0:1782607500.331675:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: 00000000908c771a/0x8109266df35caeb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35caebd expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607500.331743:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782607500.331749:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000e8976d5b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+3:6281:x1869199364329088:12345-0@lo:104: Request processed in 88us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607500.331755:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1782607500.331922:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782607500.331928:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: 00000000908c771a/0x8109266df35caeb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35caebd expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607500.331935:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000908c771a already unused, calling callback (00000000458cbea2) 10000000:00010000:1.0:1782607500.331938:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: 00000000908c771a/0x8109266df35caeb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8109266df35caebd expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607500.331945:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: 00000000908c771a/0x8109266df35caeb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8109266df35caebd expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782607500.331953:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: 00000000908c771a/0x8109266df35caeb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8109266df35caebd expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782607500.331958:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782607500.331996:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: 00000000908c771a/0x8109266df35caeb6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35caebd expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607500.332014:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782607500.332030:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: 00000000908c771a/0x8109266df35caeb6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35caebd expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607500.332036:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: 00000000908c771a/0x8109266df35caeb6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35caebd expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607500.332053:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607500.332054:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607500.332056:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607500.332066:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001456aa72 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364329216:0@lo:103: 00000100:00100000:1.0:1782607500.332094:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607500.332137:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364329216 00000100:00100000:1.0:1782607500.332141:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364329216 00010000:00010000:1.0:1782607500.332156:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000fa915ac/0x8109266df35caebd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35caeb6 expref: 12 pid: 5795 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607500.332178:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782607500.332183:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000926afbb2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+12:3319:x1869199364329216:12345-0@lo:103: 00010000:00010000:1.0:1782607500.332193:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782607500.332197:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000fa915ac/0x8109266df35caebd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35caeb6 expref: 12 pid: 5795 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607500.332205:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000fa915ac/0x8109266df35caebd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8109266df35caeb6 expref: 12 pid: 5795 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607500.332221:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000006500af02/0x8109266df35caefc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607500.332238:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006500af02/0x8109266df35caefc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607500.332252:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006500af02/0x8109266df35caefc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607500.332258:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006500af02/0x8109266df35caefc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607500.332264:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006500af02/0x8109266df35caefc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607500.332269:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006500af02/0x8109266df35caefc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607500.332274:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006500af02 already unused, calling callback (000000007523438a) 00010000:00010000:1.0:1782607500.332277:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006500af02/0x8109266df35caefc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607500.332283:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006500af02/0x8109266df35caefc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607500.332291:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006500af02/0x8109266df35caefc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607500.332300:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782607500.332326:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000926afbb2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+12:3319:x1869199364329216:12345-0@lo:103: Request processed in 144us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607500.332334:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782607500.332371:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001456aa72 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364329216:0@lo:103: 00010000:00010000:3.0:1782607500.332906:0:6281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000fa915ac/0x8109266df35caebd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8109266df35caeb6 expref: 11 pid: 5795 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607500.332919:0:6281:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007e6db4a1 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6281:1869199364329088:0@lo:104: 00010000:00010000:3.0:1782607500.332935:0:6281:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000006500af02/0x8109266df35caefc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607500.332956:0:6281:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000006500af02/0x8109266df35caefc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607500.332962:0:6281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006500af02/0x8109266df35caefc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607500.332969:0:6281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006500af02/0x8109266df35caefc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607500.358637:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001456aa72 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869199364329344:0@lo:400: 00000100:00100000:1.0:1782607500.358704:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607500.358838:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364329344 00000100:00100000:1.0:1782607500.358847:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364329344 00000100:00100000:1.0:1782607500.358892:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782607500.358901:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000c026b8da pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869199364329344:12345-0@lo:400: 00000100:00100000:1.0:1782607500.358954:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000c026b8da pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869199364329344:12345-0@lo:400: Request processed in 54us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607500.358961:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1782607500.358999:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000001456aa72 x1869199364329344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782607516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607500.359013:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001456aa72 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869199364329344:0@lo:400: 00010000:00010000:0.0:1782607500.487619:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607501.506034:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782607501.634729:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782607501.634740:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff974544151000 from 1 10000000:01000000:1.0:1782607501.634747:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782607501.634835:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: 00000000fec069a7/0x8109266df35caf03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607501.635157:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: 00000000fec069a7/0x8109266df35caf03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607501.635170:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: 00000000fec069a7/0x8109266df35caf03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607501.635203:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001456aa72 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364329472:0@lo:101: 00000100:00100000:1.0:1782607501.635296:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607501.635367:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set 00000000729cff96 going to sleep for 11 seconds 00000100:00100000:3.0:1782607501.635451:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364329472 00000100:00100000:3.0:1782607501.635460:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364329472 00000100:00100000:3.0:1782607501.635536:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782607501.635546:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000d7da9287 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+11:5800:x1869199364329472:12345-0@lo:101: 00010000:00010000:3.0:1782607501.635565:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607501.635584:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f252d391/0x8109266df35caf0a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35caf03 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607501.635622:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f252d391/0x8109266df35caf0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35caf03 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607501.635635:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f252d391/0x8109266df35caf0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35caf03 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607501.635644:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f252d391, rc 0) 00000100:00100000:3.0:1782607501.636301:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000d7da9287 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+12:5800:x1869199364329472:12345-0@lo:101: Request processed in 754us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607501.636311:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1782607501.637809:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001456aa72 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364329472:0@lo:101: 00010000:00010000:1.0:1782607501.637843:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: 00000000fec069a7/0x8109266df35caf03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35caf0a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607501.638064:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: 00000000fec069a7/0x8109266df35caf03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35caf0a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607501.638166:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001456aa72 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364329600:0@lo:501: 00000100:00100000:1.0:1782607501.638236:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607501.638284:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set 00000000729cff96 going to sleep for 11 seconds 00000100:00100000:0.0:1782607501.638348:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364329600 00000100:00100000:0.0:1782607501.638356:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364329600 00000100:00100000:0.0:1782607501.638410:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782607501.638419:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000f4986efa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+12:5800:x1869199364329600:12345-0@lo:501: 00000100:00100000:0.0:1782607501.639312:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000f4986efa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+12:5800:x1869199364329600:12345-0@lo:501: Request processed in 891us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607501.639324:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782607501.639385:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001456aa72 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364329600:0@lo:501: 00000100:00100000:0.0:1782607501.639452:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002f43a8eb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364329728:0@lo:503: 00000100:00100000:0.0:1782607501.639497:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607501.639539:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b594c3d8 going to sleep for 11 seconds 00000100:00100000:3.0:1782607501.639603:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364329728 00000100:00100000:3.0:1782607501.639625:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364329728 00000100:00100000:3.0:1782607501.639663:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782607501.639671:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000055174162 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+12:5800:x1869199364329728:12345-0@lo:503: 00000100:00100000:3.0:1782607501.640099:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000055174162 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+12:5800:x1869199364329728:12345-0@lo:503: Request processed in 428us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607501.640106:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782607501.640148:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002f43a8eb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364329728:0@lo:503: 00000100:00100000:3.0:1782607501.640383:0:6319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007e6db4a1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:6319:1869199364329856:0@lo:502: 00000100:00100000:3.0:1782607501.640420:0:6319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607501.640440:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364329856 00000100:00100000:3.0:1782607501.640443:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364329856 00000100:00100000:3.0:1782607501.640462:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782607501.640467:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000f8a17780 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+12:6319:x1869199364329856:12345-0@lo:502: 00000100:00100000:3.0:1782607501.640618:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000f8a17780 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+12:6319:x1869199364329856:12345-0@lo:502: Request processed in 151us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607501.640626:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782607501.640654:0:6319:0:(client.c:2701:ptlrpc_set_wait()) set 00000000cce3c3f1 going to sleep for 11 seconds 00000100:00100000:3.0:1782607501.640667:0:6319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007e6db4a1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:6319:1869199364329856:0@lo:502: 00000020:01000000:3.0:1782607501.642843:0:6319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782607501.643148:0:6319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782607501.643151:0:6319:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1782607501.643163:0:6319:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff974544151000 00000020:00000080:3.0:1782607501.643166:0:6319:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1782607501.643257:0:6319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d463800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:6319:1869199364329984:0@lo:502: 00000100:00100000:3.0:1782607501.643348:0:6319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607501.643403:0:6319:0:(client.c:2701:ptlrpc_set_wait()) set ffff974577a59000 going to sleep for 11 seconds 00000100:00100000:0.0:1782607501.643700:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364329984 00000100:00100000:0.0:1782607501.643710:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364329984 00000100:00100000:0.0:1782607501.643787:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782607501.643798:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974550828050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+12:6319:x1869199364329984:12345-0@lo:502: 00000100:00100000:0.0:1782607501.644348:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974550828050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+12:6319:x1869199364329984:12345-0@lo:502: Request processed in 549us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607501.644358:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782607501.644845:0:6319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d463800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:6319:1869199364329984:0@lo:502: 00000020:01000000:3.0:1782607501.645386:0:6319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782607501.645398:0:6319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782607501.645401:0:6319:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1782607501.645407:0:6319:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1782607501.646753:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1782607501.648428:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782607501.648449:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9745821d0400/0x8109266df35caf03 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35caf0a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607501.648463:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff9745821d0400/0x8109266df35caf03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35caf0a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607502.543188:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607503.554201:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607504.578891:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607505.473934:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745508ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1869199364330240:0@lo:400: 00000100:00100000:1.0:1782607505.474013:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607505.474094:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364330240 00000100:00100000:1.0:1782607505.474102:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364330240 00000100:00100000:1.0:1782607505.474150:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782607505.474160:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1869199364330240:12345-0@lo:400: 00000100:00100000:1.0:1782607505.474214:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1869199364330240:12345-0@lo:400: Request processed in 55us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607505.474221:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1782607505.474272:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9745508ca680 x1869199364330240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782607521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607505.474288:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745508ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1869199364330240:0@lo:400: 00000100:00100000:2.0:1782607505.474360:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745508c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fae11c6e-4506-4104-bb8c-df42498f7e08:3317:1869199364330112:0@lo:400: 00000100:00100000:2.0:1782607505.474408:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607505.474547:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364330112 00000100:00100000:1.0:1782607505.474550:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364330112 00000100:00100000:1.0:1782607505.474583:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782607505.474590:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+12:3317:x1869199364330112:12345-0@lo:400: 00000100:00100000:1.0:1782607505.474636:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+12:3317:x1869199364330112:12345-0@lo:400: Request processed in 46us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607505.474642:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782607505.474683:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745508c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fae11c6e-4506-4104-bb8c-df42498f7e08:3317:1869199364330112:0@lo:400: 00010000:00010000:0.0:1782607505.609049:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1782607506.283626:0:6606:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1782607506.283631:0:6606:0:(obd_mount.c:917:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1782607506.284004:0:6606:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff97455053f000 00000020:01000004:2.0:1782607506.284021:0:6606:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1782607506.284108:0:6606:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1782607506.284130:0:6606:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9745810ccd40) 00000020:00000080:2.0:1782607506.284150:0:6606:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1782607506.309474:0:6606:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1782607506.310208:0:6606:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1782607506.344832:0:6606:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1782607506.354226:0:6606:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1782607506.354261:0:6606:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1782607506.354321:0:6606:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1782607506.354351:0:6606:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1782607506.355192:0:6606:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1782607506.355203:0:6606:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1782607506.355214:0:6606:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8109266df35caf18 00000020:01000004:3.0:1782607506.355221:0:6606:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1782607506.355241:0:6606:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.202.104@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1782607506.355245:0:6606:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1782607506.355251:0:6606:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1782607506.355256:0:6606:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1782607506.355268:0:6606:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff974544318000) 00000020:00000080:3.0:1782607506.355278:0:6606:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1782607506.356565:0:6606:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782607506.356706:0:6606:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1782607506.356711:0:6606:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1782607506.357785:0:6606:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1782607506.357794:0:6606:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1782607506.358615:0:6606:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1782607506.358623:0:6606:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1782607506.365154:0:6606:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782607506.365317:0:6606:0:(service.c:3461:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1782607506.365323:0:6606:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1782607506.370117:0:6606:0:(service.c:3461:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1782607506.370130:0:6606:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1782607506.399363:0:6606:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782607506.399705:0:6606:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1782607506.399711:0:6606:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1782607506.402656:0:6606:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1782607506.402669:0:6606:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1782607506.404094:0:6606:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1782607506.404104:0:6606:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1782607506.409543:0:6606:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782607506.410125:0:6606:0:(service.c:3461:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1782607506.410133:0:6606:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1782607506.411263:0:6606:0:(service.c:3461:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1782607506.411274:0:6606:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1782607506.494188:0:6606:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782607506.494480:0:6606:0:(service.c:3461:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1782607506.494499:0:6606:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1782607506.498734:0:6606:0:(service.c:3461:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1782607506.499240:0:6606:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1782607506.505604:0:6606:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1782607506.505648:0:6606:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1782607506.505655:0:6606:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.104@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1782607506.553604:0:6606:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.104@tcp ctxt 0 is initialized 00000020:01000004:3.0:1782607506.554582:0:6606:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.104@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1782607506.554588:0:6606:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1782607506.554590:0:6606:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1782607506.554591:0:6606:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782607506.554592:0:6606:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782607506.554594:0:6606:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782607506.554595:0:6606:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782607506.554597:0:6606:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782607506.554598:0:6606:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782607506.554600:0:6606:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782607506.554601:0:6606:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782607506.554602:0:6606:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782607506.554607:0:6606:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1782607506.554609:0:6606:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782607506.554610:0:6606:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1782607506.554612:0:6606:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782607506.554613:0:6606:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782607506.554614:0:6606:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782607506.554615:0:6606:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782607506.554616:0:6606:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782607506.554617:0:6606:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782607506.554618:0:6606:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782607506.554619:0:6606:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782607506.554620:0:6606:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782607506.555118:0:6606:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1782607506.555139:0:6606:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d463800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:6606:1869199364330368:0@lo:253: 00000100:00100000:3.0:1782607506.555215:0:6606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607506.555330:0:6606:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745510dd600 going to sleep for 11 seconds 00000100:00100000:1.0:1782607506.559289:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364330368 00000100:00100000:1.0:1782607506.559303:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364330368 00000100:00100000:1.0:1782607506.559497:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1782607506.559511:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+12:6606:x1869199364330368:12345-0@lo:253: 20000000:01000000:1.0:1782607506.559552:0:5795:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1782607506.559557:0:5795:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1782607506.559562:0:5795:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1782607506.559566:0:5795:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1782607506.563246:0:5795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782607506.563972:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1782607506.564297:0:5795:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1782607506.564360:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1782607506.564446:0:5795:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1782607506.564502:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1782607506.564762:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1782607506.566363:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1782607506.566468:0:5795:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.202.104@tcp 20000000:01000000:1.0:1782607506.566471:0:5795:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.202.104@tcp (null) (null) (null) 00000040:00080000:1.0:1782607506.566621:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1782607506.566630:0:5795:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1782607506.566814:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1782607506.566825:0:5795:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.104@tcp (null) (null) 00000040:00080000:1.0:1782607506.567162:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1782607506.567174:0:5795:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1782607506.567204:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1782607506.567249:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1782607506.568499:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1782607506.568590:0:5795:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.202.104@tcp 20000000:01000000:1.0:1782607506.568593:0:5795:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.202.104@tcp (null) (null) (null) 00000040:00080000:1.0:1782607506.568628:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1782607506.568696:0:5795:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1782607506.569117:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1782607506.569129:0:5795:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.104@tcp (null) (null) 00000040:00080000:0.0:1782607506.569186:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1782607506.569208:0:5795:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1782607506.569234:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1782607506.569265:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1782607506.569284:0:5795:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1782607506.569287:0:5795:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1782607506.569291:0:5795:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1782607506.569303:0:5795:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1782607506.569306:0:5795:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1782607506.569336:0:5795:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1782607506.569339:0:5795:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1782607506.572928:0:6621:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1782607506.580189:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1782607506.580250:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1782607506.580328:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1782607506.580347:0:5795:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1782607506.580350:0:5795:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1782607506.597163:0:6622:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1782607506.597254:0:6622:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1782607506.597306:0:6622:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1782607506.597976:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1782607506.598148:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1782607506.598245:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1782607506.598261:0:5795:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1782607506.598264:0:5795:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1782607506.600756:0:6623:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:3.0:1782607506.600899:0:6623:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:3.0:1782607506.600967:0:6623:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1782607506.602263:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1782607506.602318:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1782607506.602394:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1782607506.602416:0:5795:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1782607506.602418:0:5795:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1782607506.602429:0:5795:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1782607506.602452:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9745821d1200/0x8109266df35caf26 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607506.602474:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff974540031a00/0x8109266df35cae3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cae38 expref: 12 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607506.602494:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9745585ac400/0x8109266df35cae5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cae54 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607506.602502:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff974540030e00/0x8109266df35caecb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35caec4 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607506.602512:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9745821d1200/0x8109266df35caf26 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607506.602563:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff974540030e00/0x8109266df35caecb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8109266df35caec4 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607506.602590:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff974540030e00/0x8109266df35caecb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8109266df35caec4 expref: 12 pid: 5797 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607506.602605:0:5795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745508c9180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5795:1869199364330496:0@lo:104: 00000100:00100000:1.0:1782607506.603316:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782607506.603684:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9745585ac400/0x8109266df35cae5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8109266df35cae54 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607506.603697:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9745585ac400/0x8109266df35cae5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8109266df35cae54 expref: 12 pid: 5797 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607506.603708:0:5795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745508caa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5795:1869199364330624:0@lo:104: 00000100:00100000:1.0:1782607506.603738:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782607506.603800:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff974540031a00/0x8109266df35cae3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8109266df35cae38 expref: 12 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607506.603809:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff974540031a00/0x8109266df35cae3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8109266df35cae38 expref: 12 pid: 5795 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607506.603817:0:5795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745508ca300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5795:1869199364330752:0@lo:104: 00000100:00100000:1.0:1782607506.603839:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607506.603861:0:5795:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745508969c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782607506.604583:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364330496 00000100:00100000:3.0:1782607506.604592:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364330496 00000100:00100000:3.0:1782607506.604653:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364330624 00000100:00100000:3.0:1782607506.604656:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364330624 00000100:00100000:3.0:1782607506.604668:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364330752 00000100:00100000:3.0:1782607506.604670:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364330752 00000100:00100000:3.0:1782607506.604684:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782607506.604693:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+5:5795:x1869199364330496:12345-0@lo:104: 00010000:00010000:3.0:1782607506.604708:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff9745585ad400/0x8109266df35caec4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35caecb expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607506.604805:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782607506.604811:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+5:5795:x1869199364330496:12345-0@lo:104: Request processed in 120us (1499us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607506.604818:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782607506.604836:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782607506.604842:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+4:5795:x1869199364330624:12345-0@lo:104: 00010000:00010000:2.0:1782607506.604944:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782607506.604951:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff9745585ad400/0x8109266df35caec4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35caecb expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607506.604959:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ad400 already unused, calling callback (ffffffffc1db0c20) 10000000:00010000:2.0:1782607506.604963:0:5790:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff9745585ad400/0x8109266df35caec4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8109266df35caecb expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607506.604972:0:5790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff9745585ad400/0x8109266df35caec4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8109266df35caecb expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782607506.604979:0:5790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff9745585ad400/0x8109266df35caec4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8109266df35caecb expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782607506.604985:0:5790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782607506.605029:0:5790:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff9745585ad400/0x8109266df35caec4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35caecb expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607506.605035:0:5790:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782607506.605053:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff9745585ad400/0x8109266df35caec4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35caecb expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607506.605060:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff9745585ad400/0x8109266df35caec4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35caecb expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607506.605072:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607506.605074:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607506.605076:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782607506.605113:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580c07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364330880:0@lo:103: 00000100:00100000:2.0:1782607506.605170:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782607506.605214:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff974540031e00/0x8109266df35cae54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cae5b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607506.605250:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782607506.605256:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+4:5795:x1869199364330624:12345-0@lo:104: Request processed in 414us (1518us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607506.605262:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782607506.605276:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782607506.605281:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+3:5795:x1869199364330752:12345-0@lo:104: 00010000:00010000:3.0:1782607506.605289:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff974540030600/0x8109266df35cae38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cae3f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607506.605326:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782607506.605331:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+3:5795:x1869199364330752:12345-0@lo:104: Request processed in 51us (1492us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607506.605337:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782607506.605819:0:5795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745508c9180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5795:1869199364330496:0@lo:104: 00000100:00100000:1.0:1782607506.605828:0:5795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745508caa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5795:1869199364330624:0@lo:104: 00000100:00100000:1.0:1782607506.605836:0:5795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745508ca300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5795:1869199364330752:0@lo:104: 00010000:00010000:1.0:1782607506.605887:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9745821d1200/0x8109266df35caf26 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607506.606393:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782607506.606400:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974540031e00/0x8109266df35cae54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cae5b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607506.606408:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974540031e00 already unused, calling callback (ffffffffc1db0c20) 10000000:00010000:1.0:1782607506.606412:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974540031e00/0x8109266df35cae54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8109266df35cae5b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607506.606420:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974540031e00/0x8109266df35cae54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8109266df35cae5b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782607506.606428:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974540031e00/0x8109266df35cae54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8109266df35cae5b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782607506.606434:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782607506.606472:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974540031e00/0x8109266df35cae54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cae5b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607506.606480:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782607506.606511:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974540031e00/0x8109266df35cae54 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cae5b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607506.606529:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974540031e00/0x8109266df35cae54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cae5b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607506.606542:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782607506.606546:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974540030600/0x8109266df35cae38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cae3f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607506.606564:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974540030600 already unused, calling callback (ffffffffc1db0c20) 10000000:00010000:1.0:1782607506.606567:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974540030600/0x8109266df35cae38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8109266df35cae3f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607506.606575:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974540030600/0x8109266df35cae38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8109266df35cae3f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782607506.606581:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974540030600/0x8109266df35cae38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8109266df35cae3f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782607506.606585:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782607506.606599:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974540030600/0x8109266df35cae38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cae3f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607506.606605:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782607506.606610:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974540030600/0x8109266df35cae38 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cae3f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607506.606617:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974540030600/0x8109266df35cae38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cae3f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607506.606632:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607506.606634:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607506.606636:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607506.607403:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745508caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fae11c6e-4506-4104-bb8c-df42498f7e08:3317:1869199364331136:0@lo:103: 00000100:00100000:1.0:1782607506.607460:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607506.607831:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364330880 00000100:00100000:3.0:1782607506.607839:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364330880 00010000:00010000:3.0:1782607506.607885:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff974540030e00/0x8109266df35caecb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35caec4 expref: 13 pid: 5797 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607506.607912:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364331136 00000100:00100000:3.0:1782607506.607914:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364331136 00010000:00010000:3.0:1782607506.607924:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff974540031a00/0x8109266df35cae3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cae38 expref: 14 pid: 5795 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607506.607937:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782607506.607944:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580c07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+14:3319:x1869199364330880:12345-0@lo:103: 00010000:00010000:3.0:1782607506.607956:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782607506.607961:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff974540030e00/0x8109266df35caecb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35caec4 expref: 14 pid: 5797 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607506.607971:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff974540030e00/0x8109266df35caecb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8109266df35caec4 expref: 14 pid: 5797 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607506.607985:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974540030e00/0x8109266df35caecb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8109266df35caec4 expref: 14 pid: 5797 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607506.608013:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782607506.608048:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580c07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+13:3319:x1869199364330880:12345-0@lo:103: Request processed in 105us (2878us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607506.608071:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782607506.608087:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782607506.608106:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+12:3317:x1869199364331136:12345-0@lo:103: 00010000:00010000:3.0:1782607506.608114:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782607506.608119:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff974540031a00/0x8109266df35cae3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cae38 expref: 12 pid: 5795 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607506.608127:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff974540031a00/0x8109266df35cae3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8109266df35cae38 expref: 12 pid: 5795 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607506.608136:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974540031a00/0x8109266df35cae3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8109266df35cae38 expref: 12 pid: 5795 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607506.608145:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782607506.608169:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+11:3317:x1869199364331136:12345-0@lo:103: Request processed in 76us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607506.608174:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782607506.608547:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745508ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fae11c6e-4506-4104-bb8c-df42498f7e08:3316:1869199364331008:0@lo:103: 00000100:00100000:0.0:1782607506.608581:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607506.608629:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364331008 00000100:00100000:3.0:1782607506.608633:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364331008 00010000:00010000:3.0:1782607506.608656:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9745585ac400/0x8109266df35cae5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cae54 expref: 11 pid: 5797 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607506.608670:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782607506.608677:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581539f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+11:3316:x1869199364331008:12345-0@lo:103: 00010000:00010000:3.0:1782607506.608685:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782607506.608690:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9745585ac400/0x8109266df35cae5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cae54 expref: 11 pid: 5797 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607506.608698:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9745585ac400/0x8109266df35cae5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8109266df35cae54 expref: 11 pid: 5797 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607506.608716:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9745585ac400/0x8109266df35cae5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8109266df35cae54 expref: 11 pid: 5797 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607506.608728:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9745821d1200/0x8109266df35caf26 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607506.608736:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9745821d1200/0x8109266df35caf26 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607506.608751:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9745821d1200/0x8109266df35caf26 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607506.608758:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9745821d1200/0x8109266df35caf26 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607506.608783:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9745821d1200/0x8109266df35caf26 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607506.608791:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9745821d1200/0x8109266df35caf26 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607506.608797:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745821d1200 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:3.0:1782607506.608802:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9745821d1200/0x8109266df35caf26 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607506.608810:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9745821d1200/0x8109266df35caf26 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607506.608826:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9745821d1200/0x8109266df35caf26 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607506.608856:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782607506.608881:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581539f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+10:3316:x1869199364331008:12345-0@lo:103: Request processed in 205us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607506.608888:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782607506.609292:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580c07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364330880:0@lo:103: 00010000:00010000:2.0:1782607506.609326:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607506.609401:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745508caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fae11c6e-4506-4104-bb8c-df42498f7e08:3317:1869199364331136:0@lo:103: 00010000:00010000:1.0:1782607506.609435:0:5795:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9745821d1200/0x8109266df35caf26 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607506.609452:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9745821d1200/0x8109266df35caf26 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607506.609458:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9745821d1200/0x8109266df35caf26 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782607506.609474:0:5795:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1782607506.609983:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745508ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fae11c6e-4506-4104-bb8c-df42498f7e08:3316:1869199364331008:0@lo:103: 00010000:00010000:0.0:1782607506.629694:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607506.734952:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+9:6606:x1869199364330368:12345-0@lo:253: Request processed in 175436us (179727us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607506.734979:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782607506.735220:0:6606:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d463800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:6606:1869199364330368:0@lo:253: 10000000:01000000:2.0:1782607506.735237:0:6606:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1782607506.735240:0:6606:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782607506.735242:0:6606:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782607506.735244:0:6606:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782607506.735245:0:6606:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1782607506.735246:0:6606:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782607506.735248:0:6606:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782607506.735249:0:6606:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782607506.735251:0:6606:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1782607506.735252:0:6606:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782607506.735253:0:6606:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1782607506.735280:0:6606:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97455053f000 from lustre-OST0000 10000000:01000000:2.0:1782607506.735308:0:6606:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1782607506.735311:0:6606:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1782607506.735318:0:6606:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff974549e68000 local copy 10000000:01000000:2.0:1782607506.735322:0:6606:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1782607506.735362:0:6606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9745585ad400/0x8109266df35caf2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607506.735386:0:6606:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.104@tcp lock: ffff9745585ad400/0x8109266df35caf2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607506.735396:0:6606:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff9745585ad400/0x8109266df35caf2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607506.735416:0:6606:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580c07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:6606:1869199364331264:0@lo:101: 00000100:00100000:2.0:1782607506.735458:0:6606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607506.735864:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364331264 00000100:00100000:1.0:1782607506.735872:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364331264 00000100:00100000:1.0:1782607506.735929:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1782607506.735939:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+9:6606:x1869199364331264:12345-0@lo:101: 00010000:00010000:1.0:1782607506.735955:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607506.735981:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9745821d1200/0x8109266df35caf34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35caf2d expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607506.736155:0:6606:0:(client.c:2701:ptlrpc_set_wait()) set ffff974578ff1480 going to sleep for 11 seconds 00010000:00010000:1.0:1782607506.736292:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9745821d1200/0x8109266df35caf34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35caf2d expref: 10 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607506.736304:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9745821d1200/0x8109266df35caf34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35caf2d expref: 10 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607506.736315:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745821d1200, rc 0) 00000100:00100000:1.0:1782607506.736431:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+10:6606:x1869199364331264:12345-0@lo:101: Request processed in 430us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607506.736438:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1782607506.736553:0:6606:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580c07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:6606:1869199364331264:0@lo:101: 00010000:00010000:2.0:1782607506.736569:0:6606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff9745585ad400/0x8109266df35caf2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x8109266df35caf34 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607506.736578:0:6606:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff9745585ad400/0x8109266df35caf2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8109266df35caf34 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607506.736709:0:6606:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580c07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:6606:1869199364331392:0@lo:501: 00000100:00100000:2.0:1782607506.736738:0:6606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607506.736803:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364331392 00000100:00100000:1.0:1782607506.736808:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364331392 00000100:00100000:1.0:1782607506.736833:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782607506.736840:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+10:6606:x1869199364331392:12345-0@lo:501: 00000100:00100000:1.0:1782607506.737324:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+10:6606:x1869199364331392:12345-0@lo:501: Request processed in 483us (584us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782607506.737332:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782607506.737646:0:6606:0:(client.c:2701:ptlrpc_set_wait()) set ffff974578ff1480 going to sleep for 11 seconds 00000100:00100000:2.0:1782607506.737664:0:6606:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580c07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:6606:1869199364331392:0@lo:501: 10000000:01000000:2.0:1782607506.737679:0:6606:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1782607506.737710:0:6606:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1782607506.737716:0:6606:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9745585ad400/0x8109266df35caf2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8109266df35caf34 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607506.737724:0:6606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9745585ad400/0x8109266df35caf2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8109266df35caf34 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607506.737731:0:6606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff9745585ad400/0x8109266df35caf2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8109266df35caf34 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607506.737819:0:6606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1782607506.737839:0:6606:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97455053f000 10000000:01000000:2.0:1782607506.737851:0:6606:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1782607506.737856:0:6606:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff974549e68000 10000000:01000000:2.0:1782607506.737858:0:6606:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1782607506.737862:0:6606:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff974549e68000 from 1 10000000:01000000:2.0:1782607506.737873:0:6606:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782607506.737899:0:6606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9745585adc00/0x8109266df35caf3b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607506.737906:0:6606:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff9745585adc00/0x8109266df35caf3b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607506.737915:0:6606:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff9745585adc00/0x8109266df35caf3b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607506.737929:0:6606:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580c07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:6606:1869199364331520:0@lo:101: 00000100:00100000:2.0:1782607506.738134:0:6606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607506.738156:0:6606:0:(client.c:2701:ptlrpc_set_wait()) set ffff974578ff1540 going to sleep for 11 seconds 00000100:00100000:1.0:1782607506.738219:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364331520 00000100:00100000:1.0:1782607506.738225:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364331520 00000100:00100000:1.0:1782607506.738271:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782607506.738280:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+10:6606:x1869199364331520:12345-0@lo:101: 00010000:00010000:1.0:1782607506.738290:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607506.738301:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9745821d0e00/0x8109266df35caf42 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35caf3b expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607506.738321:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9745821d0e00/0x8109266df35caf42 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35caf3b expref: 11 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607506.738330:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9745821d0e00/0x8109266df35caf42 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35caf3b expref: 11 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607506.738338:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745821d0e00, rc 0) 00000100:00100000:1.0:1782607506.738532:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+11:6606:x1869199364331520:12345-0@lo:101: Request processed in 252us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607506.738538:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:0.0:1782607506.740503:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782607506.740579:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff9745585ad400/0x8109266df35caf2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x8109266df35caf34 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607506.740609:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ad400 already unused, calling callback (ffffffffc1db0c20) 10000000:00010000:0.0:1782607506.740613:0:5790:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff9745585ad400/0x8109266df35caf2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x8109266df35caf34 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607506.740623:0:5790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff9745585ad400/0x8109266df35caf2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x8109266df35caf34 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782607506.740629:0:5790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff9745585ad400/0x8109266df35caf2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x8109266df35caf34 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782607506.740635:0:5790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782607506.740672:0:5790:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff9745585ad400/0x8109266df35caf2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x8109266df35caf34 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607506.740677:0:5790:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1782607506.740762:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1782607506.740815:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff9745585ad400/0x8109266df35caf2d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x8109266df35caf34 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607506.740823:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff9745585ad400/0x8109266df35caf2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x8109266df35caf34 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607506.740842:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607506.740968:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607506.740972:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782607506.741215:0:6606:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580c07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:6606:1869199364331520:0@lo:101: 00010000:00010000:3.0:1782607506.741236:0:6606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff9745585adc00/0x8109266df35caf3b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35caf42 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607506.741245:0:6606:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff9745585adc00/0x8109266df35caf3b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35caf42 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782607506.741265:0:6606:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782607506.741796:0:6606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9745585adc00/0x8109266df35caf3b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35caf42 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607506.741805:0:6606:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff9745585adc00/0x8109266df35caf3b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35caf42 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782607506.741813:0:6606:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1782607506.741821:0:6606:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782607506.741828:0:6606:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1782607506.741831:0:6606:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1782607506.742136:0:6606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974582050a00/0x8109266df35caf49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607506.742145:0:6606:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974582050a00/0x8109266df35caf49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607506.742171:0:6606:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974582050a00/0x8109266df35caf49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607506.742191:0:6606:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d460700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:6606:1869199364331776:0@lo:101: 00000100:00100000:3.0:1782607506.742253:0:6606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607506.742302:0:6606:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745510ddb40 going to sleep for 11 seconds 00000100:00100000:1.0:1782607506.742384:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364331776 00000100:00100000:1.0:1782607506.742391:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364331776 00000100:00100000:1.0:1782607506.742462:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782607506.742472:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+11:6606:x1869199364331776:12345-0@lo:101: 00010000:00010000:1.0:1782607506.742503:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607506.742819:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9745821d0000/0x8109266df35caf50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35caf49 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607506.742844:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9745821d0000/0x8109266df35caf50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35caf49 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607506.742863:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9745821d0000/0x8109266df35caf50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35caf49 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607506.742872:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745821d0000, rc 0) 00000100:00100000:1.0:1782607506.742915:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+12:6606:x1869199364331776:12345-0@lo:101: Request processed in 446us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607506.742924:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782607506.743208:0:6606:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d460700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:6606:1869199364331776:0@lo:101: 00010000:00010000:3.0:1782607506.743222:0:6606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974582050a00/0x8109266df35caf49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35caf50 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607506.743230:0:6606:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974582050a00/0x8109266df35caf49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35caf50 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607506.743356:0:6606:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d460700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:6606:1869199364331904:0@lo:501: 00000100:00100000:3.0:1782607506.743399:0:6606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607506.743433:0:6606:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745510ddb40 going to sleep for 11 seconds 00000100:00100000:1.0:1782607506.743598:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364331904 00000100:00100000:1.0:1782607506.743603:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364331904 00000100:00100000:1.0:1782607506.743646:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1782607506.743654:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+12:6606:x1869199364331904:12345-0@lo:501: 00000100:00100000:1.0:1782607506.744191:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+12:6606:x1869199364331904:12345-0@lo:501: Request processed in 537us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607506.744198:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782607506.744293:0:6606:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d460700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:6606:1869199364331904:0@lo:501: 00000100:00100000:3.0:1782607506.744326:0:6606:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d460700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:6606:1869199364332032:0@lo:503: 00000100:00100000:3.0:1782607506.744364:0:6606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607506.744400:0:6606:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745510ddb40 going to sleep for 11 seconds 00000100:00100000:1.0:1782607506.744513:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364332032 00000100:00100000:1.0:1782607506.744527:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364332032 00000100:00100000:1.0:1782607506.744561:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782607506.744570:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+12:6606:x1869199364332032:12345-0@lo:503: 00000100:00100000:1.0:1782607506.744704:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+12:6606:x1869199364332032:12345-0@lo:503: Request processed in 135us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607506.744710:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782607506.746304:0:6606:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d460700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:6606:1869199364332032:0@lo:503: 00000040:00080000:3.0:1782607506.746653:0:6606:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782607506.746730:0:6606:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d460700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:6606:1869199364332160:0@lo:502: 00000100:00100000:3.0:1782607506.746815:0:6606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607506.747106:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364332160 00000100:00100000:1.0:1782607506.747113:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364332160 00000100:00100000:1.0:1782607506.747159:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1782607506.747169:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+12:6606:x1869199364332160:12345-0@lo:502: 00000100:00100000:1.0:1782607506.747337:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+12:6606:x1869199364332160:12345-0@lo:502: Request processed in 170us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607506.747344:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782607506.747553:0:6606:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745510ddb40 going to sleep for 11 seconds 00000100:00100000:3.0:1782607506.747575:0:6606:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d460700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:6606:1869199364332160:0@lo:502: 00000100:00100000:1.0:1782607506.748164:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97458153bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364331648:0@lo:103: 00000100:00100000:1.0:1782607506.748199:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607506.748286:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364331648 00000100:00100000:2.0:1782607506.748292:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364331648 00000100:00100000:2.0:1782607506.748333:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782607506.748340:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+12:3319:x1869199364331648:12345-0@lo:103: 00010000:00010000:2.0:1782607506.748352:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782607506.748428:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9745821d1200/0x8109266df35caf34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8109266df35caf2d expref: 12 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607506.748445:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782607506.748473:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+11:3319:x1869199364331648:12345-0@lo:103: Request processed in 134us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607506.748479:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:3.0:1782607506.748576:0:6606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1782607506.748643:0:6606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1782607506.748669:0:6606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1782607506.748717:0:6606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1782607506.748752:0:6606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1782607506.748825:0:6606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1782607506.748950:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97458153bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364331648:0@lo:103: 00000100:00100000:3.0:1782607506.749234:0:6606:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d460700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:6606:1869199364332288:0@lo:502: 00000100:00100000:3.0:1782607506.749287:0:6606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607506.749350:0:6606:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745510ddb40 going to sleep for 11 seconds 00000100:00100000:1.0:1782607506.749447:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364332288 00000100:00100000:1.0:1782607506.749452:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364332288 00000100:00100000:1.0:1782607506.749540:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1782607506.749549:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+11:6606:x1869199364332288:12345-0@lo:502: 00000100:00100000:1.0:1782607506.749720:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+11:6606:x1869199364332288:12345-0@lo:502: Request processed in 173us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607506.749727:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782607506.749814:0:6606:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d460700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:6606:1869199364332288:0@lo:502: 00000040:00080000:0.0:1782607506.749922:0:6606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1782607506.749941:0:6606:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1782607506.750822:0:6625:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1782607506.750829:0:6625:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1782607506.750841:0:6625:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782607506.750843:0:6625:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1782607506.750858:0:6625:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782607506.750881:0:6625:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff97457f5fcd40) 00000020:00000080:0.0:1782607506.750901:0:6625:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1782607506.750906:0:6625:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1782607506.750971:0:6625:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97455053f000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1782607506.750978:0:6625:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1782607506.750984:0:6625:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8109266df35caf5e 00010000:00010000:0.0:1782607506.756468:0:6625:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1782607506.757172:0:6625:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1782607506.759842:0:6625:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1782607506.760219:0:6625:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1782607506.767391:0:6625:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1782607506.768240:0:6625:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1782607506.776951:0:6625:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1782607506.776975:0:6625:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782607506.776982:0:6625:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782607506.776984:0:6625:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1782607506.777160:0:6625:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782607506.777165:0:6625:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782607506.777167:0:6625:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1782607506.777171:0:6625:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1782607506.777172:0:6625:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1782607506.777238:0:6625:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782607506.777250:0:6625:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782607506.777252:0:6625:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1782607506.777255:0:6625:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1782607506.779722:0:6606:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1782607506.779795:0:6606:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1782607506.779817:0:6606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974582050a00/0x8109266df35caf49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35caf50 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607506.779831:0:6606:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974582050a00/0x8109266df35caf49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35caf50 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782607506.779840:0:6606:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff97455053f000 from 1 10000000:01000000:3.0:1782607506.779852:0:6606:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782607506.779894:0:6606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974582051c00/0x8109266df35caf65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607506.779902:0:6606:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974582051c00/0x8109266df35caf65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607506.779913:0:6606:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974582051c00/0x8109266df35caf65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607506.779936:0:6606:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d460380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:6606:1869199364332416:0@lo:101: 00000100:00100000:3.0:1782607506.780034:0:6606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607506.780084:0:6606:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745510dd900 going to sleep for 11 seconds 00000100:00100000:1.0:1782607506.780324:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364332416 00000100:00100000:1.0:1782607506.780332:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364332416 00000100:00100000:1.0:1782607506.780401:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782607506.780412:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+11:6606:x1869199364332416:12345-0@lo:101: 00010000:00010000:1.0:1782607506.780426:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607506.780439:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9745821d1200/0x8109266df35caf6c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35caf65 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607506.780462:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9745821d1200/0x8109266df35caf6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35caf65 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607506.780498:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9745821d1200/0x8109266df35caf6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35caf65 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607506.780507:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745821d1200, rc 0) 00000100:00100000:1.0:1782607506.780549:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+12:6606:x1869199364332416:12345-0@lo:101: Request processed in 140us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607506.780556:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1782607506.780723:0:6606:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d460380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:6606:1869199364332416:0@lo:101: 00010000:00010000:3.0:1782607506.780738:0:6606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974582051c00/0x8109266df35caf65 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35caf6c expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607506.780747:0:6606:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974582051c00/0x8109266df35caf65 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35caf6c expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607506.780887:0:6606:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d460380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:6606:1869199364332544:0@lo:501: 00000100:00100000:3.0:1782607506.780915:0:6606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607506.780933:0:6606:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745510dd900 going to sleep for 11 seconds 00000100:00100000:1.0:1782607506.783194:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364332544 00000100:00100000:1.0:1782607506.783206:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364332544 00000100:00100000:1.0:1782607506.783268:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782607506.783280:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+12:6606:x1869199364332544:12345-0@lo:501: 00000100:00100000:1.0:1782607506.783593:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+12:6606:x1869199364332544:12345-0@lo:501: Request processed in 316us (2677us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607506.783601:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782607506.784189:0:6606:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d460380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:6606:1869199364332544:0@lo:501: 00000100:00100000:3.0:1782607506.784242:0:6606:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d460380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:6606:1869199364332672:0@lo:503: 00000100:00100000:3.0:1782607506.784292:0:6606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607506.784330:0:6606:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745510dd900 going to sleep for 11 seconds 00000100:00100000:1.0:1782607506.785239:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364332672 00000100:00100000:1.0:1782607506.785247:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364332672 00000100:00100000:1.0:1782607506.785296:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782607506.785305:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+12:6606:x1869199364332672:12345-0@lo:503: 00000100:00100000:1.0:1782607506.786493:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+12:6606:x1869199364332672:12345-0@lo:503: Request processed in 1175us (2186us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607506.786504:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1782607506.790535:0:6606:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d460380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:6606:1869199364332672:0@lo:503: 00000040:00080000:2.0:1782607506.791565:0:6606:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782607506.791653:0:6606:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580c04700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:6606:1869199364332800:0@lo:502: 00000100:00100000:2.0:1782607506.791746:0:6606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607506.791842:0:6606:0:(client.c:2701:ptlrpc_set_wait()) set ffff974578ff1000 going to sleep for 11 seconds 00000100:00100000:3.0:1782607506.792164:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364332800 00000100:00100000:3.0:1782607506.792173:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364332800 00000100:00100000:3.0:1782607506.792232:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1782607506.792252:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+12:6606:x1869199364332800:12345-0@lo:502: 00000100:00100000:3.0:1782607506.792510:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+12:6606:x1869199364332800:12345-0@lo:502: Request processed in 268us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607506.792519:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782607506.793568:0:6606:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580c04700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:6606:1869199364332800:0@lo:502: 00000040:00080000:2.0:1782607506.793946:0:6606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1782607506.794664:0:6606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1782607506.794707:0:6606:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580c04700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:6606:1869199364332928:0@lo:502: 00000100:00100000:2.0:1782607506.795097:0:6606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607506.795239:0:6606:0:(client.c:2701:ptlrpc_set_wait()) set ffff974578ff1000 going to sleep for 11 seconds 00000100:00100000:1.0:1782607506.795327:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364332928 00000100:00100000:1.0:1782607506.795334:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364332928 00000100:00100000:1.0:1782607506.795514:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1782607506.795527:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+12:6606:x1869199364332928:12345-0@lo:502: 00000100:00100000:1.0:1782607506.795738:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+12:6606:x1869199364332928:12345-0@lo:502: Request processed in 214us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607506.795752:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1782607506.795880:0:6606:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580c04700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:6606:1869199364332928:0@lo:502: 00000040:00080000:2.0:1782607506.796026:0:6606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1782607506.796038:0:6606:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1782607506.796981:0:6629:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782607506.797002:0:6629:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782607506.797005:0:6629:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1782607506.797012:0:6629:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff97455053f000 00000020:00000080:2.0:1782607506.797014:0:6629:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1782607506.797034:0:6629:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782607506.797038:0:6629:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782607506.797040:0:6629:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1782607506.797043:0:6629:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1782607506.797227:0:6606:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1782607506.797265:0:6606:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782607506.797289:0:6606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974582051c00/0x8109266df35caf65 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35caf6c expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607506.797301:0:6606:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974582051c00/0x8109266df35caf65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35caf6c expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782607506.797343:0:6606:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1782607506.797346:0:6606:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97455053f000 10000000:01000000:0.0:1782607506.797350:0:6606:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97455053f000 10000000:01000000:0.0:1782607506.797354:0:6606:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1782607506.797360:0:6606:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff97455053f000 from 1 10000000:01000000:0.0:1782607506.797363:0:6606:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782607506.797406:0:6606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974540031a00/0x8109266df35caf73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607506.797423:0:6606:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974540031a00/0x8109266df35caf73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607506.797434:0:6606:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974540031a00/0x8109266df35caf73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607506.797454:0:6606:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581539500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:6606:1869199364333056:0@lo:101: 00000100:00100000:0.0:1782607506.797518:0:6606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607506.798215:0:6606:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745511a4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782607506.798419:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364333056 00000100:00100000:3.0:1782607506.798428:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364333056 00000100:00100000:3.0:1782607506.798465:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1782607506.798495:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+12:6606:x1869199364333056:12345-0@lo:101: 00010000:00010000:3.0:1782607506.798509:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607506.798525:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974582050c00/0x8109266df35caf7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35caf73 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607506.798549:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974582050c00/0x8109266df35caf7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35caf73 expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607506.798561:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974582050c00/0x8109266df35caf7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35caf73 expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607506.798571:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974582050c00, rc 0) 00000100:00100000:3.0:1782607506.798623:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+13:6606:x1869199364333056:12345-0@lo:101: Request processed in 141us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607506.798631:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1782607506.798722:0:6606:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581539500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:6606:1869199364333056:0@lo:101: 00010000:00010000:0.0:1782607506.798747:0:6606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974540031a00/0x8109266df35caf73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35caf7a expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607506.798756:0:6606:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974540031a00/0x8109266df35caf73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35caf7a expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607506.799103:0:6606:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581539500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:6606:1869199364333184:0@lo:501: 00000100:00100000:0.0:1782607506.799133:0:6606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607506.799161:0:6606:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745511a4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782607506.799212:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364333184 00000100:00100000:3.0:1782607506.799217:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364333184 00000100:00100000:3.0:1782607506.799237:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1782607506.799312:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+13:6606:x1869199364333184:12345-0@lo:501: 00000100:00100000:3.0:1782607506.799640:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+13:6606:x1869199364333184:12345-0@lo:501: Request processed in 331us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607506.799647:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1782607506.799934:0:6606:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581539500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:6606:1869199364333184:0@lo:501: 00000100:00100000:0.0:1782607506.800110:0:6606:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581539500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:6606:1869199364333312:0@lo:503: 00000100:00100000:0.0:1782607506.800154:0:6606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607506.800178:0:6606:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745511a4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782607506.800237:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364333312 00000100:00100000:3.0:1782607506.800442:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364333312 00000100:00100000:3.0:1782607506.800601:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1782607506.800610:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+13:6606:x1869199364333312:12345-0@lo:503: 00000100:00100000:3.0:1782607506.800808:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+13:6606:x1869199364333312:12345-0@lo:503: Request processed in 198us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607506.800824:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1782607506.800920:0:6606:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581539500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:6606:1869199364333312:0@lo:503: 00000040:00080000:0.0:1782607506.801480:0:6606:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782607506.801569:0:6606:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581539500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:6606:1869199364333440:0@lo:502: 00000100:00100000:0.0:1782607506.801614:0:6606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607506.802182:0:6606:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745511a4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1782607506.802223:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364333440 00000100:00100000:1.0:1782607506.802231:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364333440 00000100:00100000:1.0:1782607506.802329:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1782607506.802338:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+13:6606:x1869199364333440:12345-0@lo:502: 00000100:00100000:1.0:1782607506.805344:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+13:6606:x1869199364333440:12345-0@lo:502: Request processed in 2996us (3718us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607506.805359:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1782607506.807647:0:6606:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581539500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:6606:1869199364333440:0@lo:502: 00000040:00080000:0.0:1782607506.808566:0:6606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1782607506.808639:0:6606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1782607506.808676:0:6606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1782607506.808724:0:6606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1782607506.808800:0:6606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1782607506.809083:0:6606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1782607506.809129:0:6606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1782607506.809160:0:6606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1782607506.809203:0:6606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1782607506.809238:0:6606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1782607506.809276:0:6606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1782607506.809325:0:6606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1782607506.809364:0:6606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1782607506.809468:0:6606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1782607506.809536:0:6606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1782607506.809572:0:6606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1782607506.809610:0:6606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1782607506.809661:0:6606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1782607506.809695:0:6606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1782607506.809729:0:6606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1782607506.809818:0:6606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1782607506.810161:0:6606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1782607506.810209:0:6606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1782607506.810333:0:6606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1782607506.810454:0:6606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1782607506.810534:0:6606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1782607506.810593:0:6606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1782607506.810646:0:6606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1782607506.810698:0:6606:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581539500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:6606:1869199364333568:0@lo:502: 00000100:00100000:0.0:1782607506.810820:0:6606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607506.811114:0:6606:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745511a4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782607506.811204:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364333568 00000100:00100000:3.0:1782607506.811213:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364333568 00000100:00100000:3.0:1782607506.811319:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782607506.811330:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+13:6606:x1869199364333568:12345-0@lo:502: 00000100:00100000:3.0:1782607506.811592:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+13:6606:x1869199364333568:12345-0@lo:502: Request processed in 263us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607506.811601:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1782607506.811826:0:6606:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581539500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:6606:1869199364333568:0@lo:502: 00000040:00080000:0.0:1782607506.811926:0:6606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1782607506.811941:0:6606:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1782607506.813525:0:6630:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1782607506.813543:0:6630:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9745810c99c0) 00000020:00000080:2.0:1782607506.813563:0:6630:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1782607506.813747:0:6630:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97455053f000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1782607506.813751:0:6630:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97455053f000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1782607506.813754:0:6630:0:(obd_mount.c:701:lustre_put_lsi()) put ffff97455053f000 3 00010000:00080000:2.0:1782607506.813803:0:6630:0:(ldlm_lib.c:102:import_set_conn()) imp ffff974577167800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.104@tcp at head 00010000:00010000:2.0:1782607506.822547:0:6630:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1782607506.822641:0:6630:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1782607506.822677:0:6630:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1782607506.822688:0:6630:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x8109266df35caf88 00000100:00080000:2.0:1782607506.822698:0:6630:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782607506.822704:0:6630:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff974577167800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1782607506.822751:0:6630:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff974580c04700 x1869199364333696/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782607506.822807:0:6630:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1782607506.824272:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580c04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3315:1869199364333696:0@lo:38: 00000100:00100000:0.0:1782607506.824354:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607506.824422:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364333696 00000100:00100000:0.0:1782607506.824429:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364333696 00000100:00100000:0.0:1782607506.824462:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782607506.824469:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581539500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3315:x1869199364333696:12345-0@lo:38: 00010000:00080000:0.0:1782607506.824504:0:5805:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 165 last 0 00000020:00000080:0.0:1782607506.824537:0:5805:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x8109266df35caf8f 00000004:00100000:0.0:1782607506.824550:0:5805:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1782607506.824582:0:5805:0:(import.c:65:import_set_state_nolock()) ffff97457f846000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782607506.824628:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581539500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869199364333696:12345-0@lo:38: Request processed in 158us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607506.824634:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1782607506.824670:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff974580c04700 x1869199364333696/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782607516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782607506.824680:0:3315:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782607506.824686:0:3315:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1782607506.824692:0:3315:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1782607506.824697:0:3315:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1782607506.824708:0:3315:0:(import.c:65:import_set_state_nolock()) ffff974577167800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1782607506.824714:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580c04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3315:1869199364333696:0@lo:38: 00000100:00100000:1.0:1782607506.827611:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782607506.827639:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580c04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1869199364333824:0@lo:400: 00000100:00100000:1.0:1782607506.827714:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607506.827866:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364333824 00000100:00100000:2.0:1782607506.827874:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364333824 00000100:00100000:2.0:1782607506.827923:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782607506.827932:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1869199364333824:12345-0@lo:400: 00000100:00100000:2.0:1782607506.828201:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1869199364333824:12345-0@lo:400: Request processed in 269us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607506.828208:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1782607506.828270:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff974580c04380 x1869199364333824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782607522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607506.828283:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580c04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1869199364333824:0@lo:400: 00000040:00080000:3.0:1782607506.839361:0:6630:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1782607506.840564:0:6606:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1782607506.840593:0:6606:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782607506.840625:0:6606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974540031a00/0x8109266df35caf73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35caf7a expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607506.840639:0:6606:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974540031a00/0x8109266df35caf73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35caf7a expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1782607506.840700:0:6606:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1782607506.840702:0:6606:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782607506.840704:0:6606:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782607506.840705:0:6606:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782607506.840706:0:6606:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782607506.840708:0:6606:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782607506.840709:0:6606:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782607506.840711:0:6606:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782607506.840712:0:6606:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782607506.840714:0:6606:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782607506.840715:0:6606:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1782607506.840719:0:6606:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1782607506.840722:0:6606:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782607506.840723:0:6606:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782607506.840724:0:6606:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782607506.840725:0:6606:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782607506.840726:0:6606:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782607506.840727:0:6606:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782607506.840728:0:6606:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782607506.840729:0:6606:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782607506.840730:0:6606:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782607506.840732:0:6606:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782607506.840733:0:6606:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1782607506.840759:0:6606:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1782607506.840810:0:6606:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97458153ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:6606:1869199364333952:0@lo:253: 00000100:00100000:0.0:1782607506.840919:0:6606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607506.841157:0:6606:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745511a4600 going to sleep for 11 seconds 00000100:00100000:2.0:1782607506.843471:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364333952 00000100:00100000:2.0:1782607506.843496:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364333952 00000100:00100000:2.0:1782607506.843599:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1782607506.843609:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+13:6606:x1869199364333952:12345-0@lo:253: 20000000:01000000:2.0:1782607506.843646:0:5797:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1782607506.843677:0:5797:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1782607506.873164:0:5797:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1782607506.873179:0:5797:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1782607506.873259:0:5819:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1782607506.873266:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1782607506.873292:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff974540030e00/0x8109266df35caf96 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607506.873312:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9745585ac200/0x8109266df35caef5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35caeee expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607506.873321:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff974540030e00/0x8109266df35caf96 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607506.873374:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9745585ac200/0x8109266df35caef5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8109266df35caeee expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607506.873389:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9745585ac200/0x8109266df35caef5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8109266df35caeee expref: 13 pid: 5797 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607506.873404:0:5819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97458153b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5819:1869199364334080:0@lo:104: 00000100:00100000:0.0:1782607506.873466:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607506.873531:0:5819:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745710416c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782607506.873595:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364334080 00000100:00100000:2.0:1782607506.873603:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364334080 00000100:00100000:2.0:1782607506.873662:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782607506.873672:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458153b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+3:5819:x1869199364334080:12345-0@lo:104: 00010000:00010000:2.0:1782607506.873684:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff9745821d0800/0x8109266df35caeee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35caef5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607506.873735:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782607506.873741:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458153b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+3:5819:x1869199364334080:12345-0@lo:104: Request processed in 72us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607506.873748:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1782607506.873967:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782607506.873973:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff9745821d0800/0x8109266df35caeee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35caef5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607506.873981:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745821d0800 already unused, calling callback (ffffffffc1db0c20) 10000000:00010000:0.0:1782607506.873992:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff9745821d0800/0x8109266df35caeee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8109266df35caef5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607506.874002:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff9745821d0800/0x8109266df35caeee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8109266df35caef5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782607506.874024:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff9745821d0800/0x8109266df35caeee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8109266df35caef5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782607506.874031:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1782607506.874067:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff9745821d0800/0x8109266df35caeee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35caef5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607506.874074:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782607506.874093:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff9745821d0800/0x8109266df35caeee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35caef5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607506.874101:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff9745821d0800/0x8109266df35caeee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35caef5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607506.874117:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607506.874119:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607506.874120:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782607506.874134:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581538e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fae11c6e-4506-4104-bb8c-df42498f7e08:3316:1869199364334208:0@lo:103: 00000100:00100000:0.0:1782607506.874170:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607506.874215:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364334208 00000100:00100000:0.0:1782607506.874219:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364334208 00010000:00010000:0.0:1782607506.874238:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9745585ac200/0x8109266df35caef5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35caeee expref: 14 pid: 5797 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607506.874261:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782607506.874267:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974548806050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fae11c6e-4506-4104-bb8c-df42498f7e08+14:3316:x1869199364334208:12345-0@lo:103: 00010000:00010000:0.0:1782607506.874278:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782607506.874283:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9745585ac200/0x8109266df35caef5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35caeee expref: 14 pid: 5797 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607506.874299:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9745585ac200/0x8109266df35caef5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8109266df35caeee expref: 14 pid: 5797 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607506.874315:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff974540030e00/0x8109266df35caf96 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607506.874323:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974540030e00/0x8109266df35caf96 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1782607506.874336:0:5789:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001071768s 00010000:00010000:0.0:1782607506.874340:0:5789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff974540030e00/0x8109266df35caf96 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607506.874346:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff974540030e00/0x8109266df35caf96 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607506.874352:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff974540030e00/0x8109266df35caf96 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607506.874358:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff974540030e00/0x8109266df35caf96 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607506.874363:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974540030e00 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:0.0:1782607506.874367:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff974540030e00/0x8109266df35caf96 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607506.874373:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff974540030e00/0x8109266df35caf96 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607506.874382:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff974540030e00/0x8109266df35caf96 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607506.874403:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782607506.874430:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974548806050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fae11c6e-4506-4104-bb8c-df42498f7e08+14:3316:x1869199364334208:12345-0@lo:103: Request processed in 164us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607506.874437:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782607506.874512:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581538e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fae11c6e-4506-4104-bb8c-df42498f7e08:3316:1869199364334208:0@lo:103: 00010000:00010000:0.0:1782607506.874538:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9745585ac200/0x8109266df35caef5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8109266df35caeee expref: 13 pid: 5797 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607506.874548:0:5819:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97458153b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5819:1869199364334080:0@lo:104: 00010000:00010000:0.0:1782607506.874558:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff974540030e00/0x8109266df35caf96 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607506.874566:0:5819:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff974540030e00/0x8109266df35caf96 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607506.874572:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff974540030e00/0x8109266df35caf96 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607506.874583:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974540030e00/0x8109266df35caf96 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607506.880859:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+12:6606:x1869199364333952:12345-0@lo:253: Request processed in 37233us (39921us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607506.880875:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1782607506.881079:0:6606:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97458153ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:6606:1869199364333952:0@lo:253: 10000000:01000000:0.0:1782607506.881096:0:6606:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1782607506.881099:0:6606:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782607506.881101:0:6606:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782607506.881102:0:6606:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782607506.881104:0:6606:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782607506.881105:0:6606:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782607506.881120:0:6606:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782607506.881122:0:6606:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782607506.881123:0:6606:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782607506.881124:0:6606:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782607506.881126:0:6606:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782607506.881127:0:6606:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1782607506.881144:0:6606:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1782607506.887648:0:6606:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1782607506.887914:0:6606:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1782607506.888326:0:6606:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1782607506.889197:0:6606:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1782607506.889599:0:6606:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1782607506.890466:0:6606:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1782607506.893291:0:6606:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1782607507.236472:0:6606:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1782607507.236507:0:6606:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1782607507.236559:0:6606:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1782607507.236618:0:6606:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.104@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1782607507.236632:0:6606:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1782607507.236658:0:6606:0:(super25.c:188:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1782607507.654671:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607508.698375:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782607508.998075:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782607508.998085:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff974544151000 from 21 10000000:01000000:3.0:1782607508.998092:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782607508.998140:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974582050400/0x8109266df35caf9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607508.998153:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974582050400/0x8109266df35caf9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607508.998166:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974582050400/0x8109266df35caf9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607508.998193:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d460a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364334336:0@lo:101: 00000100:00100000:3.0:1782607508.998265:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607508.998330:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff97455d443300 going to sleep for 11 seconds 00000100:00100000:0.0:1782607508.998896:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364334336 00000100:00100000:0.0:1782607508.998905:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364334336 00000100:00100000:0.0:1782607508.998953:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1782607508.999118:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+12:5800:x1869199364334336:12345-0@lo:101: 00010000:00010000:0.0:1782607508.999135:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607508.999151:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974540031e00/0x8109266df35cafa4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35caf9d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607508.999175:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974540031e00/0x8109266df35cafa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35caf9d expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607508.999185:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974540031e00/0x8109266df35cafa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35caf9d expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607508.999194:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974540031e00, rc 0) 00000100:00100000:0.0:1782607508.999912:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+13:5800:x1869199364334336:12345-0@lo:101: Request processed in 946us (1643us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607508.999921:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1782607509.003029:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d460a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364334336:0@lo:101: 00010000:00010000:3.0:1782607509.003066:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974582050400/0x8109266df35caf9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cafa4 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607509.003079:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974582050400/0x8109266df35caf9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cafa4 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607509.003157:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d460a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364334464:0@lo:501: 00000100:00100000:3.0:1782607509.003217:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607509.003262:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff97455d443300 going to sleep for 11 seconds 00000100:00100000:2.0:1782607509.007019:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364334464 00000100:00100000:2.0:1782607509.007034:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364334464 00000100:00100000:2.0:1782607509.007102:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782607509.007113:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+13:5800:x1869199364334464:12345-0@lo:501: 00000100:00100000:2.0:1782607509.007439:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+13:5800:x1869199364334464:12345-0@lo:501: Request processed in 328us (4220us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607509.007446:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782607509.007518:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d460a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364334464:0@lo:501: 00000100:00100000:2.0:1782607509.007569:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580c04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364334592:0@lo:503: 00000100:00100000:2.0:1782607509.007613:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607509.007643:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff974578ff1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782607509.007657:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364334592 00000100:00100000:2.0:1782607509.007661:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364334592 00000100:00100000:2.0:1782607509.007684:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782607509.007697:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+13:5800:x1869199364334592:12345-0@lo:503: 00000100:00100000:2.0:1782607509.009353:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+13:5800:x1869199364334592:12345-0@lo:503: Request processed in 1651us (1734us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607509.009366:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1782607509.015208:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580c04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364334592:0@lo:503: 00000100:00100000:2.0:1782607509.016628:0:6706:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580c04000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:6706:1869199364334720:0@lo:502: 00000100:00100000:2.0:1782607509.016709:0:6706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607509.016754:0:6706:0:(client.c:2701:ptlrpc_set_wait()) set ffff974578ff1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782607509.017089:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364334720 00000100:00100000:0.0:1782607509.017095:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364334720 00000100:00100000:0.0:1782607509.017145:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782607509.017154:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+13:6706:x1869199364334720:12345-0@lo:502: 00000100:00100000:0.0:1782607509.017405:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+13:6706:x1869199364334720:12345-0@lo:502: Request processed in 251us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607509.017413:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1782607509.021181:0:6706:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580c04000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:6706:1869199364334720:0@lo:502: 00000100:00100000:2.0:1782607509.021273:0:6706:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580c04000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:6706:1869199364334848:0@lo:502: 00000100:00100000:2.0:1782607509.021346:0:6706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607509.021395:0:6706:0:(client.c:2701:ptlrpc_set_wait()) set ffff974578ff1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782607509.021714:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364334848 00000100:00100000:0.0:1782607509.021721:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364334848 00000100:00100000:0.0:1782607509.021811:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1782607509.021822:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+13:6706:x1869199364334848:12345-0@lo:502: 00000100:00100000:0.0:1782607509.022065:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+13:6706:x1869199364334848:12345-0@lo:502: Request processed in 244us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607509.022074:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1782607509.022565:0:6706:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580c04000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:6706:1869199364334848:0@lo:502: 00000040:00080000:2.0:1782607509.022592:0:6706:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1782607509.022838:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1782607509.022858:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782607509.022869:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974582050400/0x8109266df35caf9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cafa4 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607509.022880:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974582050400/0x8109266df35caf9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cafa4 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782607509.022889:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1782607509.022891:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff974544151000 from 4 10000000:01000000:0.0:1782607509.022894:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1782607509.022927:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974540031200/0x8109266df35cafab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607509.022936:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974540031200/0x8109266df35cafab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607509.022944:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974540031200/0x8109266df35cafab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607509.022982:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97458153ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364334976:0@lo:101: 00000100:00100000:0.0:1782607509.023020:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607509.023062:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff974544271a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782607509.024584:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364334976 00000100:00100000:2.0:1782607509.024595:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364334976 00000100:00100000:2.0:1782607509.024651:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1782607509.024660:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+13:5800:x1869199364334976:12345-0@lo:101: 00010000:00010000:2.0:1782607509.024676:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607509.024693:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9745585ac000/0x8109266df35cafb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cafab expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607509.024720:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9745585ac000/0x8109266df35cafb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cafab expref: 14 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607509.024729:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9745585ac000/0x8109266df35cafb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cafab expref: 14 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607509.024752:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585ac000, rc 0) 00000100:00100000:2.0:1782607509.024855:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+14:5800:x1869199364334976:12345-0@lo:101: Request processed in 194us (1833us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607509.024861:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1782607509.026242:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97458153ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364334976:0@lo:101: 00010000:00010000:0.0:1782607509.026270:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974540031200/0x8109266df35cafab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cafb2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607509.026281:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974540031200/0x8109266df35cafab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cafb2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607509.026371:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97458153ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364335104:0@lo:256: 00000100:00100000:0.0:1782607509.026431:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607509.026487:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff974544271a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782607509.028124:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364335104 00000100:00100000:2.0:1782607509.028139:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364335104 00000100:00100000:2.0:1782607509.028209:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782607509.028220:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+14:5800:x1869199364335104:12345-0@lo:256: 20000000:01000000:2.0:1782607509.028247:0:5795:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1782607509.028272:0:5795:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1782607509.028275:0:5795:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1782607509.028415:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+14:5800:x1869199364335104:12345-0@lo:256: Request processed in 196us (1983us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607509.028423:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1782607509.028657:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97458153ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364335104:0@lo:256: 10000000:01000000:0.0:1782607509.028714:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1782607509.028733:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974540031200/0x8109266df35cafab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cafb2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607509.028745:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974540031200/0x8109266df35cafab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cafb2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782607509.028755:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1782607509.028758:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1782607509.028761:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1782607509.028822:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974540030800/0x8109266df35cafb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607509.028843:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974540030800/0x8109266df35cafb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607509.028853:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974540030800/0x8109266df35cafb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607509.028873:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97458153ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364335232:0@lo:101: 00000100:00100000:0.0:1782607509.028907:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607509.028941:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff974544271a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782607509.029326:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364335232 00000100:00100000:2.0:1782607509.029332:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364335232 00000100:00100000:2.0:1782607509.029370:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782607509.029377:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+14:5800:x1869199364335232:12345-0@lo:101: 00010000:00010000:2.0:1782607509.029388:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607509.029402:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9745585acc00/0x8109266df35cafc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cafb9 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607509.029425:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9745585acc00/0x8109266df35cafc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cafb9 expref: 15 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607509.029435:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9745585acc00/0x8109266df35cafc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cafb9 expref: 15 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607509.029456:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585acc00, rc 0) 00000100:00100000:2.0:1782607509.029501:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+15:5800:x1869199364335232:12345-0@lo:101: Request processed in 123us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607509.029508:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1782607509.030463:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97458153ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364335232:0@lo:101: 00010000:00010000:0.0:1782607509.030497:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974540030800/0x8109266df35cafb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cafc0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607509.030508:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974540030800/0x8109266df35cafb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cafc0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607509.030578:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97458153ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364335360:0@lo:501: 00000100:00100000:0.0:1782607509.030620:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607509.030665:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff974544271a80 going to sleep for 11 seconds 00000100:00100000:1.0:1782607509.030796:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364335360 00000100:00100000:1.0:1782607509.030802:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364335360 00000100:00100000:1.0:1782607509.030839:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1782607509.030847:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+15:5800:x1869199364335360:12345-0@lo:501: 00000100:00100000:1.0:1782607509.031113:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+15:5800:x1869199364335360:12345-0@lo:501: Request processed in 266us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607509.031121:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1782607509.031350:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97458153ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364335360:0@lo:501: 00000100:00100000:0.0:1782607509.031380:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97458153ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364335488:0@lo:503: 00000100:00100000:0.0:1782607509.031417:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607509.031441:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff974544271a80 going to sleep for 11 seconds 00000100:00100000:1.0:1782607509.041626:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364335488 00000100:00100000:1.0:1782607509.041642:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364335488 00000100:00100000:1.0:1782607509.041699:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1782607509.041710:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+15:5800:x1869199364335488:12345-0@lo:503: 00000100:00100000:1.0:1782607509.042432:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+15:5800:x1869199364335488:12345-0@lo:503: Request processed in 721us (11011us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607509.042442:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1782607509.042526:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97458153ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364335488:0@lo:503: 00000100:00100000:1.0:1782607509.043933:0:6708:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745508cbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:6708:1869199364335616:0@lo:502: 00000100:00100000:1.0:1782607509.044075:0:6708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607509.044126:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364335616 00000100:00100000:1.0:1782607509.044133:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364335616 00000100:00100000:1.0:1782607509.044172:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1782607509.044180:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+15:6708:x1869199364335616:12345-0@lo:502: 00000100:00100000:1.0:1782607509.044457:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+15:6708:x1869199364335616:12345-0@lo:502: Request processed in 276us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607509.044479:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1782607509.044541:0:6708:0:(client.c:2701:ptlrpc_set_wait()) set ffff97455170d540 going to sleep for 11 seconds 00000100:00100000:1.0:1782607509.044560:0:6708:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745508cbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:6708:1869199364335616:0@lo:502: 00000020:01000000:1.0:1782607509.044602:0:6708:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1782607509.044611:0:6708:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1782607509.044619:0:6708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782607509.044621:0:6708:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1782607509.044626:0:6708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1782607509.044630:0:6708:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.104@tcp to nid 0x20000c0a8ca68 (192.168.202.104@tcp) 00000020:01000000:1.0:1782607509.044653:0:6708:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1782607509.044655:0:6708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782607509.044669:0:6708:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff97458150b380) 00000020:00000080:1.0:1782607509.044688:0:6708:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1782607509.044694:0:6708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1782607509.047119:0:6708:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1782607509.047146:0:6708:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:1.0:1782607509.047159:0:6708:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8109266df35cafce 00010000:00080000:1.0:1782607509.047201:0:6708:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97456fc9b000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.104@tcp at head 00010000:00010000:1.0:1782607509.047437:0:6708:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1782607509.113394:0:6708:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1782607509.113419:0:6708:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1782607509.117332:0:6708:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782607509.117607:0:6708:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782607509.117660:0:6708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1782607509.117722:0:6708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1782607509.118386:0:6710:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782607509.118392:0:6710:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1782607509.119343:0:6708:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1782607509.119371:0:6708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1782607509.119404:0:6708:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1782607509.119424:0:6708:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8109266df35cafd5 00000100:00080000:3.0:1782607509.119435:0:6708:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782607509.119441:0:6708:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97456fc9b000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1782607509.119488:0:6708:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97455d460000 x1869199364335744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782607509.119513:0:6708:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1782607509.119583:0:6708:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782607509.119588:0:6708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782607509.119590:0:6708:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1782607509.119598:0:6708:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782607509.119601:0:6708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782607509.119603:0:6708:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:3.0:1782607509.119606:0:6708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1782607509.119608:0:6708:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1782607509.119637:0:6708:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d461180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:6708:1869199364335872:0@lo:502: 00000100:00100000:3.0:1782607509.119722:0:6708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607509.119803:0:6708:0:(client.c:2701:ptlrpc_set_wait()) set ffff97455d443600 going to sleep for 11 seconds 00000100:00100000:3.0:1782607509.119889:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364335872 00000100:00100000:3.0:1782607509.119895:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364335872 00000100:00100000:3.0:1782607509.119936:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1782607509.119954:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974548ac5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+15:6708:x1869199364335872:12345-0@lo:502: 00000100:00100000:3.0:1782607509.120184:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974548ac5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+15:6708:x1869199364335872:12345-0@lo:502: Request processed in 230us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607509.120193:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1782607509.120234:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869199364336000:0@lo:400: 00000100:00100000:3.0:1782607509.120262:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607509.120299:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1869199364336128:0@lo:400: 00000100:00100000:3.0:1782607509.120321:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607509.120364:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364336000 00000100:00100000:3.0:1782607509.120368:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364336000 00000100:00100000:3.0:1782607509.120393:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364336128 00000100:00100000:3.0:1782607509.120396:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364336128 00000100:00100000:3.0:1782607509.120420:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782607509.120426:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455d462a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869199364336000:12345-0@lo:400: 00000100:00100000:3.0:1782607509.120461:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455d462a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869199364336000:12345-0@lo:400: Request processed in 35us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607509.120480:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782607509.120500:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782607509.120506:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455d463100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1869199364336128:12345-0@lo:400: 00000100:00100000:3.0:1782607509.120540:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455d463100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1869199364336128:12345-0@lo:400: Request processed in 34us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607509.120545:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1782607509.120569:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1782607509.120594:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97455d461880 x1869199364336128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782607525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607509.120609:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1869199364336128:0@lo:400: 00010000:00080000:3.0:1782607509.120637:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97455d462680 x1869199364336000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782607525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607509.120645:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869199364336000:0@lo:400: 00000100:00100000:3.0:1782607509.120666:0:6708:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d461180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:6708:1869199364335872:0@lo:502: 00000020:01000000:3.0:1782607509.120689:0:6708:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782607509.120695:0:6708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782607509.120697:0:6708:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:3.0:1782607509.120701:0:6708:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1782607509.120835:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1782607509.120853:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1782607509.120863:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974540030800/0x8109266df35cafb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cafc0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607509.120874:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974540030800/0x8109266df35cafb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cafc0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782607509.120884:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1782607509.120887:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff974549e68000 from 1 10000000:01000000:3.0:1782607509.120895:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1782607509.120922:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974582051000/0x8109266df35cafdc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607509.120930:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974582051000/0x8109266df35cafdc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607509.120939:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974582051000/0x8109266df35cafdc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607509.120953:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d461180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364336256:0@lo:101: 00000100:00100000:3.0:1782607509.120979:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607509.120999:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff97455d443600 going to sleep for 11 seconds 00000100:00100000:3.0:1782607509.121016:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364336256 00000100:00100000:3.0:1782607509.121019:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364336256 00000100:00100000:3.0:1782607509.121040:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1782607509.121046:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974548ac5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+15:5800:x1869199364336256:12345-0@lo:101: 00010000:00010000:3.0:1782607509.121055:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607509.121066:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974582051800/0x8109266df35cafe3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cafdc expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607509.121085:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974582051800/0x8109266df35cafe3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cafdc expref: 16 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607509.121094:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974582051800/0x8109266df35cafe3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cafdc expref: 16 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607509.121103:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974582051800, rc 0) 00000100:00100000:3.0:1782607509.121132:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974548ac5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+16:5800:x1869199364336256:12345-0@lo:101: Request processed in 86us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607509.121147:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1782607509.121176:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d461180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364336256:0@lo:101: 00010000:00010000:3.0:1782607509.121187:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974582051000/0x8109266df35cafdc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cafe3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607509.121195:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974582051000/0x8109266df35cafdc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cafe3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607509.121231:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d461180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364336384:0@lo:501: 00000100:00100000:3.0:1782607509.121254:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607509.121266:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff97455d443600 going to sleep for 11 seconds 00000100:00100000:3.0:1782607509.121278:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364336384 00000100:00100000:3.0:1782607509.121281:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364336384 00000100:00100000:3.0:1782607509.121298:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1782607509.121304:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974548ac7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+16:5800:x1869199364336384:12345-0@lo:501: 00000100:00100000:3.0:1782607509.121528:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974548ac7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+16:5800:x1869199364336384:12345-0@lo:501: Request processed in 222us (271us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782607509.121535:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1782607509.121563:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d461180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364336384:0@lo:501: 10000000:01000000:3.0:1782607509.121580:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1782607509.121585:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974582051000/0x8109266df35cafdc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cafe3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607509.121593:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974582051000/0x8109266df35cafdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cafe3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607509.122287:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1869199364335744:0@lo:8: 00000100:00100000:0.0:1782607509.122333:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607509.122608:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364335744 00000100:00100000:3.0:1782607509.122618:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364335744 00000100:00100000:3.0:1782607509.122695:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782607509.122701:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458153b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3315:x1869199364335744:12345-0@lo:8: 00010000:00080000:3.0:1782607509.122725:0:6608:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 167 last 0 00000020:00000080:3.0:1782607509.122751:0:6608:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8109266df35cafea 00002000:00100000:3.0:1782607509.122811:0:6608:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff97457fa05800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113669 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1782607509.122817:0:6608:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1782607509.122821:0:6608:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1782607509.123157:0:6608:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1782607509.123329:0:6608:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1782607509.123369:0:6608:0:(import.c:65:import_set_state_nolock()) ffff97457fa02800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782607509.123435:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458153b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1869199364335744:12345-0@lo:8: Request processed in 732us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607509.123444:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1782607509.123525:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97455d460000 x1869199364335744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782607519 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607509.123539:0:3315:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1782607509.123547:0:3315:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1782607509.123556:0:3315:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1782607509.123561:0:3315:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1782607509.123564:0:3315:0:(import.c:65:import_set_state_nolock()) ffff97456fc9b000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1782607509.123579:0:3315:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1782607509.123585:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1869199364335744:0@lo:8: 00000004:00080000:1.0:1782607509.123612:0:6710:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1782607509.123722:0:6710:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 167969955554ns, next at 0ns, rc = 0 00000004:00080000:3.0:1782607509.171527:0:6711:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1782607509.171562:0:6711:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d462680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6711:1869199364336640:0@lo:7: 00000100:00100000:3.0:1782607509.171643:0:6711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607509.171689:0:6711:0:(client.c:2701:ptlrpc_set_wait()) set ffff97455d443840 going to sleep for 11 seconds 00000004:00080000:3.0:1782607509.171711:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1782607509.171739:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782607509.172030:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364336512:0@lo:13: 00000100:00100000:3.0:1782607509.172062:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607509.172114:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364336640 00000100:00100000:3.0:1782607509.172122:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364336640 00000100:00100000:3.0:1782607509.172177:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782607509.172186:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455d461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6711:x1869199364336640:12345-0@lo:7: 00000100:00100000:1.0:1782607509.173868:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364336512 00000100:00100000:1.0:1782607509.173879:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364336512 00000100:00100000:1.0:1782607509.173923:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782607509.173944:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455d460000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1869199364336512:12345-0@lo:13: 00002000:00000024:1.0:1782607509.173974:0:6612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1782607509.174053:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455d460000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1869199364336512:12345-0@lo:13: Request processed in 111us (1989us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607509.174061:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1782607509.176562:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782607509.179114:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97455d461180 x1869199364336512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607525 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607509.179153:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364336512:0@lo:13: 00002000:00080000:3.0:1782607509.189724:0:6610:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1782607509.189736:0:6610:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1782607509.190778:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455d461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6711:x1869199364336640:12345-0@lo:7: Request processed in 18573us (19115us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607509.190800:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1782607509.190993:0:6711:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97455d462680 x1869199364336640/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782607525 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607509.191011:0:6711:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d462680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6711:1869199364336640:0@lo:7: 00000004:00080000:1.0:1782607509.191026:0:6711:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1782607509.191070:0:6711:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745508cbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6711:1869199364336768:0@lo:5: 00000100:00100000:1.0:1782607509.191107:0:6711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607509.191155:0:6711:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745776346c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782607509.191329:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364336768 00000100:00100000:3.0:1782607509.191336:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364336768 00000100:00100000:3.0:1782607509.191399:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782607509.191408:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6711:x1869199364336768:12345-0@lo:5: 00002000:00080000:3.0:1782607509.191436:0:6608:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1782607509.191441:0:6608:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1782607509.191744:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6711:x1869199364336768:12345-0@lo:5: Request processed in 336us (635us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1782607509.191752:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1782607509.191818:0:6711:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9745508cbb80 x1869199364336768/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782607525 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607509.192063:0:6711:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745508cbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6711:1869199364336768:0@lo:5: 00000004:00080000:3.0:1782607509.192074:0:6711:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1782607509.192102:0:6711:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d461180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6711:1869199364336896:0@lo:700: 00000100:00100000:3.0:1782607509.192133:0:6711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607509.192154:0:6711:0:(client.c:2701:ptlrpc_set_wait()) set ffff97455d443900 going to sleep for 11 seconds 00000100:00100000:3.0:1782607509.192178:0:6617:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364336896 00000100:00100000:3.0:1782607509.192181:0:6617:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364336896 00000100:00100000:3.0:1782607509.192207:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782607509.192213:0:6617:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455d460a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6711:x1869199364336896:12345-0@lo:700: 00000100:00100000:3.0:1782607509.192245:0:6617:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d460380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6617:1869199364337024:0@lo:700: 00000100:00100000:3.0:1782607509.192273:0:6617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607509.192292:0:6617:0:(client.c:2701:ptlrpc_set_wait()) set ffff97455d443300 going to sleep for 11 seconds 00000100:00100000:3.0:1782607509.192317:0:5810:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364337024 00000100:00100000:3.0:1782607509.192320:0:5810:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364337024 00000100:00100000:3.0:1782607509.192481:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782607509.192489:0:5810:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455d460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6617:x1869199364337024:12345-0@lo:700: 40000000:02000000:2.0:1782607509.230502:0:5810:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1782607509.239315:0:5810:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455d460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6617:x1869199364337024:12345-0@lo:700: Request processed in 46815us (47028us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607509.239341:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1782607509.239687:0:6617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97455d460380 x1869199364337024/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1782607525 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607509.239706:0:6617:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d460380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6617:1869199364337024:0@lo:700: 40000000:02000000:3.0:1782607509.239720:0:6617:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:2.0:1782607509.375612:0:6634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1782607509.375627:0:6634:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1782607509.376173:0:6617:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455d460a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6711:x1869199364336896:12345-0@lo:700: Request processed in 183954us (184034us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607509.376194:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1782607509.376255:0:6711:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97455d461180 x1869199364336896/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1782607525 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607509.376267:0:6711:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1782607509.376290:0:6711:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d461180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6711:1869199364336896:0@lo:700: 00000004:02000040:1.0:1782607509.502010:0:6711:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1782607509.515754:0:6711:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745508cbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6711:1869199364337152:0@lo:5: 00000100:00100000:1.0:1782607509.515894:0:6711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607509.515951:0:6711:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745511a4900 going to sleep for 11 seconds 00000100:00100000:3.0:1782607509.518136:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364337152 00000100:00100000:3.0:1782607509.518151:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364337152 00000100:00100000:3.0:1782607509.518243:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782607509.518254:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6711:x1869199364337152:12345-0@lo:5: 00002000:00080000:1.0:1782607509.534618:0:6610:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1782607509.534642:0:6610:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1782607509.548799:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6711:x1869199364337152:12345-0@lo:5: Request processed in 30538us (32897us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1782607509.548830:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1782607509.549450:0:6711:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9745508cbb80 x1869199364337152/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782607525 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607509.549484:0:6711:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745508cbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6711:1869199364337152:0@lo:5: 00000004:00080000:1.0:1782607509.549508:0:6711:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1782607509.697934:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607510.726353:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607511.746061:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607512.770015:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607513.794175:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782607514.178025:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869199364337408:0@lo:400: 00000100:00100000:3.0:1782607514.178125:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607514.178208:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782607514.178215:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fae11c6e-4506-4104-bb8c-df42498f7e08:3317:1869199364337280:0@lo:400: 00000100:00100000:3.0:1782607514.178253:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607514.178291:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1869199364337536:0@lo:400: 00000100:00100000:3.0:1782607514.178318:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607514.178339:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782607514.178344:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364337664:0@lo:400: 00000100:00100000:3.0:1782607514.178375:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607514.178418:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364337408 00000100:00100000:3.0:1782607514.178439:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364337408 00000100:00100000:3.0:1782607514.178495:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364337536 00000100:00100000:3.0:1782607514.178498:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364337536 00000100:00100000:3.0:1782607514.178530:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782607514.178540:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455d461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869199364337408:12345-0@lo:400: 00000100:00100000:3.0:1782607514.178607:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455d461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869199364337408:12345-0@lo:400: Request processed in 68us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607514.178615:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782607514.178635:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782607514.178642:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455d461c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1869199364337536:12345-0@lo:400: 00000100:00100000:3.0:1782607514.178673:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455d461c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1869199364337536:12345-0@lo:400: Request processed in 32us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607514.178679:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782607514.178698:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364337280 00000100:00100000:3.0:1782607514.178702:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364337280 00000100:00100000:3.0:1782607514.178729:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1782607514.178736:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+16:3317:x1869199364337280:12345-0@lo:400: 00000100:00100000:3.0:1782607514.178797:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+16:3317:x1869199364337280:12345-0@lo:400: Request processed in 61us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607514.178803:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:3.0:1782607514.178867:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97455d461500 x1869199364337536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782607530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607514.178885:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1869199364337536:0@lo:400: 00000100:00100000:3.0:1782607514.178919:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fae11c6e-4506-4104-bb8c-df42498f7e08:3317:1869199364337280:0@lo:400: 00010000:00080000:3.0:1782607514.178929:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97455d463800 x1869199364337408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782607530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607514.178946:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869199364337408:0@lo:400: 00000100:00100000:1.0:1782607514.179078:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364337664 00000100:00100000:1.0:1782607514.179083:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364337664 00000100:00100000:1.0:1782607514.179126:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782607514.179135:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455d462300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3318:x1869199364337664:12345-0@lo:400: 00000100:00100000:1.0:1782607514.179183:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455d462300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3318:x1869199364337664:12345-0@lo:400: Request processed in 49us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607514.179189:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1782607514.179209:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782607514.179215:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1782607514.179231:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97455d462d80 x1869199364337664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607514.179242:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364337664:0@lo:400: 00000100:00100000:0.0:1782607514.690361:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364337792:0@lo:13: 00000100:00100000:0.0:1782607514.690465:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607514.690604:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364337792 00000100:00100000:3.0:1782607514.690615:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364337792 00000100:00100000:3.0:1782607514.690682:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782607514.690694:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581538e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1869199364337792:12345-0@lo:13: 00002000:00000024:3.0:1782607514.690745:0:6612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782607514.690831:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581538e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1869199364337792:12345-0@lo:13: Request processed in 139us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607514.690845:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1782607514.691338:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97455d463800 x1869199364337792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607530 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782607514.691360:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364337792:0@lo:13: 00010000:00010000:1.0:1782607514.824662:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782607514.845177:0:6634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:02000400:1.0:1782607514.948952:0:6981:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1782607515.844398:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607516.867044:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607517.890219:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607518.916891:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782607519.301742:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fae11c6e-4506-4104-bb8c-df42498f7e08:3317:1869199364337920:0@lo:400: 00000100:00100000:3.0:1782607519.301871:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607519.301936:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782607519.301942:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364338304:0@lo:400: 00000100:00100000:3.0:1782607519.301972:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607519.302014:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364337920 00000100:00100000:3.0:1782607519.302024:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364337920 00000100:00100000:3.0:1782607519.302461:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1782607519.302482:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+16:3317:x1869199364337920:12345-0@lo:400: 00000100:00100000:3.0:1782607519.302560:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+16:3317:x1869199364337920:12345-0@lo:400: Request processed in 84us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607519.302570:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1782607519.302621:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364338304 00000100:00100000:3.0:1782607519.302626:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364338304 00000100:00100000:3.0:1782607519.302669:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782607519.302675:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455d461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364338304:12345-0@lo:400: 00000100:00100000:3.0:1782607519.302708:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455d461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364338304:12345-0@lo:400: Request processed in 33us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607519.302725:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1782607519.302907:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97455d462d80 x1869199364338304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607519.302921:0:3317:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1782607519.302947:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364338304:0@lo:400: 00000100:00100000:3.0:1782607519.302958:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fae11c6e-4506-4104-bb8c-df42498f7e08:3317:1869199364337920:0@lo:400: 00000100:00080000:2.0:1782607519.304848:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782607519.304880:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3319:1869199364338176:0@lo:400: 00000100:00100000:2.0:1782607519.304971:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607519.305020:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782607519.305029:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1869199364338048:0@lo:400: 00000100:00100000:2.0:1782607519.305053:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607519.306993:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364338176 00000100:00100000:2.0:1782607519.307008:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364338176 00000100:00100000:2.0:1782607519.307093:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364338048 00000100:00100000:2.0:1782607519.307097:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364338048 00000100:00100000:2.0:1782607519.307119:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782607519.307130:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580c04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1869199364338176:12345-0@lo:400: 00000100:00100000:2.0:1782607519.307248:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580c04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1869199364338176:12345-0@lo:400: Request processed in 120us (2277us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607519.307257:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782607519.307278:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782607519.307284:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580c05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1869199364338048:12345-0@lo:400: 00000100:00100000:2.0:1782607519.307313:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580c05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1869199364338048:12345-0@lo:400: Request processed in 30us (2260us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607519.307319:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1782607519.308223:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1782607519.308281:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97455d461500 x1869199364338048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782607535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782607519.308300:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1869199364338048:0@lo:400: 00010000:00080000:2.0:1782607519.308315:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97455d463800 x1869199364338176/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782607535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782607519.308323:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3319:1869199364338176:0@lo:400: 00000100:00100000:0.0:1782607519.810524:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581539f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364338432:0@lo:13: 00000100:00100000:0.0:1782607519.810628:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607519.812352:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364338432 00000100:00100000:0.0:1782607519.812370:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364338432 00000100:00100000:0.0:1782607519.812452:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782607519.812465:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581538700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364338432:12345-0@lo:13: 00002000:00000024:0.0:1782607519.812520:0:6612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782607519.812621:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581538700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364338432:12345-0@lo:13: Request processed in 158us (1992us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607519.812629:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1782607519.815305:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff974581539f80 x1869199364338432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607535 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782607519.815336:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581539f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364338432:0@lo:13: 00010000:00010000:2.0:1782607519.938190:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607520.962232:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607521.985993:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607523.014674:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607524.035605:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782607524.418404:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581538380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1869199364338688:0@lo:400: 00000100:00100000:0.0:1782607524.418497:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607524.418555:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782607524.418561:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581539f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364338560:0@lo:400: 00000100:00100000:0.0:1782607524.418589:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607524.418619:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581538a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1869199364338816:0@lo:400: 00000100:00100000:0.0:1782607524.418640:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607524.418658:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782607524.418663:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581538000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364338944:0@lo:400: 00000100:00100000:0.0:1782607524.418686:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607524.418717:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364338688 00000100:00100000:0.0:1782607524.418724:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364338688 00000100:00100000:0.0:1782607524.418801:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364338816 00000100:00100000:0.0:1782607524.418805:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364338816 00000100:00100000:2.0:1782607524.419004:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782607524.419627:0:5803:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1782607524.419636:0:5803:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1782607524.419652:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364338560 00000100:00100000:0.0:1782607524.419656:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364338560 00000100:00100000:0.0:1782607524.419681:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1782607524.419686:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581539180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1869199364338688:12345-0@lo:400: 00000100:00100000:0.0:1782607524.419687:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+16:3319:x1869199364338560:12345-0@lo:400: 00000100:00100000:0.0:1782607524.419797:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+16:3319:x1869199364338560:12345-0@lo:400: Request processed in 108us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607524.419804:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1782607524.419845:0:5805:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1782607524.419853:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782607524.419860:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458153a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869199364338816:12345-0@lo:400: 00000100:00100000:0.0:1782607524.419904:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458153a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869199364338816:12345-0@lo:400: Request processed in 45us (1263us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607524.419909:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782607524.419945:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364338944 00000100:00100000:0.0:1782607524.419949:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364338944 00000100:00100000:0.0:1782607524.419978:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782607524.419985:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581539880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364338944:12345-0@lo:400: 00000100:00100000:0.0:1782607524.420014:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581539880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364338944:12345-0@lo:400: Request processed in 30us (1327us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607524.420020:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1782607524.420036:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782607524.420040:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1782607524.420355:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff974581538000 x1869199364338944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607524.420372:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581538000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364338944:0@lo:400: 00010000:00080000:3.0:1782607524.420386:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff974581538a80 x1869199364338816/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782607540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607524.420396:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581538a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1869199364338816:0@lo:400: 00000100:00100000:2.0:1782607524.420534:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581539180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1869199364338688:12345-0@lo:400: Request processed in 1520us (2037us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607524.420540:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782607524.420791:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581539f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364338560:0@lo:400: 00010000:00080000:0.0:1782607524.420809:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff974581538380 x1869199364338688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782607540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782607524.420876:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581538380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1869199364338688:0@lo:400: 00000100:00100000:3.0:1782607524.930034:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581538380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364339072:0@lo:13: 00000100:00100000:3.0:1782607524.930112:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607524.930233:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364339072 00000100:00100000:2.0:1782607524.930242:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364339072 00000100:00100000:2.0:1782607524.930308:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782607524.930326:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455d460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364339072:12345-0@lo:13: 00002000:00000024:2.0:1782607524.930373:0:6612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782607524.930741:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455d460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364339072:12345-0@lo:13: Request processed in 425us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607524.930748:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1782607524.932128:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff974581538380 x1869199364339072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607540 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607524.932146:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581538380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364339072:0@lo:13: 00010000:00010000:1.0:1782607525.059951:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1782607525.871521:0:7507:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1782607525.871525:0:7507:0:(obd_mount.c:917:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1782607525.871881:0:7507:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff97457f5e0000 00000020:01000004:2.0:1782607525.871896:0:7507:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1782607525.871908:0:7507:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1782607525.871922:0:7507:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9745810cb380) 00000020:00000080:2.0:1782607525.871940:0:7507:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1782607525.889398:0:7507:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1782607525.890490:0:7507:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1782607525.918445:0:7507:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1782607525.925526:0:7507:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1782607525.925561:0:7507:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1782607525.925756:0:7507:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1782607525.925808:0:7507:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1782607525.926174:0:7507:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1782607525.926186:0:7507:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1782607525.926201:0:7507:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8109266df35caff8 00000020:01000004:1.0:1782607525.926209:0:7507:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1782607525.926298:0:7507:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.202.104@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1782607525.926301:0:7507:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1782607525.926380:0:7507:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1782607525.926404:0:7507:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1782607525.926408:0:7507:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.104@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1782607525.949303:0:7507:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.104@tcp ctxt 0 is initialized 00000020:01000004:1.0:1782607525.950194:0:7507:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.104@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1782607525.950200:0:7507:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1782607525.950202:0:7507:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1782607525.950203:0:7507:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782607525.950204:0:7507:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782607525.950206:0:7507:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782607525.950264:0:7507:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782607525.950267:0:7507:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782607525.950268:0:7507:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782607525.950270:0:7507:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782607525.950271:0:7507:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782607525.950272:0:7507:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1782607525.950276:0:7507:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1782607525.950279:0:7507:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1782607525.950280:0:7507:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1782607525.950282:0:7507:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782607525.950283:0:7507:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782607525.950284:0:7507:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782607525.950291:0:7507:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782607525.950292:0:7507:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782607525.950293:0:7507:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782607525.950294:0:7507:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782607525.950294:0:7507:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782607525.950295:0:7507:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1782607525.950407:0:7507:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1782607525.950427:0:7507:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745508cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:7507:1869199364339200:0@lo:253: 00000100:00100000:1.0:1782607525.950498:0:7507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607525.951369:0:7507:0:(client.c:2701:ptlrpc_set_wait()) set ffff97457f923d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782607525.952379:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364339200 00000100:00100000:3.0:1782607525.952389:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364339200 00000100:00100000:3.0:1782607525.952490:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782607525.952501:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+16:7507:x1869199364339200:12345-0@lo:253: 20000000:01000000:3.0:1782607525.952536:0:5797:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1782607525.952541:0:5797:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1782607525.952557:0:5797:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1782607525.952559:0:5797:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1782607525.954514:0:5797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782607525.955173:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1782607525.955187:0:5797:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1782607525.955286:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1782607525.955294:0:5797:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1782607525.955402:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1782607525.955448:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1782607525.956138:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1782607525.956159:0:5797:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.202.104@tcp 20000000:01000000:3.0:1782607525.956161:0:5797:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.202.104@tcp (null) (null) (null) 00000040:00080000:3.0:1782607525.956193:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1782607525.956200:0:5797:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1782607525.956302:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1782607525.956382:0:5797:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.104@tcp (null) (null) 00000040:00080000:3.0:1782607525.956416:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1782607525.956424:0:5797:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1782607525.956449:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1782607525.956489:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1782607525.958164:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1782607525.958191:0:5797:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.202.104@tcp 20000000:01000000:2.0:1782607525.958194:0:5797:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.202.104@tcp (null) (null) (null) 00000040:00080000:2.0:1782607525.958385:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1782607525.958397:0:5797:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1782607525.958434:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1782607525.958441:0:5797:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.104@tcp (null) (null) 00000040:00080000:2.0:1782607525.958468:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1782607525.958476:0:5797:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1782607525.958524:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1782607525.958567:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1782607525.958724:0:5797:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1782607525.958727:0:5797:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1782607525.958730:0:5797:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1782607525.958742:0:5797:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1782607525.958745:0:5797:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1782607525.958956:0:5797:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1782607525.958959:0:5797:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1782607525.960467:0:7509:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1782607525.960561:0:7509:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1782607525.960710:0:7509:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1782607525.961518:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1782607525.961705:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1782607525.962169:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1782607525.962189:0:5797:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1782607525.962192:0:5797:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1782607525.963192:0:7510:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1782607525.963403:0:7510:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1782607525.963461:0:7510:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1782607525.963963:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1782607525.963999:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1782607525.964205:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1782607525.964293:0:5797:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1782607525.964296:0:5797:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1782607525.965406:0:7511:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1782607525.965473:0:7511:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1782607525.965521:0:7511:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1782607525.966173:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1782607525.966273:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1782607525.966409:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1782607525.966424:0:5797:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1782607525.966426:0:5797:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1782607525.967301:0:7512:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1782607525.967926:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1782607525.967975:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1782607525.968166:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1782607525.968185:0:5797:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1782607525.968188:0:5797:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1782607525.968196:0:5797:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1782607525.968277:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff974582050600/0x8109266df35cafff lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607525.968297:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9745821d0000/0x8109266df35caf50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35caf49 expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607525.968305:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff974582050c00/0x8109266df35caf7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35caf73 expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607525.968390:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff974540031e00/0x8109266df35cafa4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35caf9d expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607525.968398:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9745585acc00/0x8109266df35cafc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cafb9 expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607525.968405:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff974582051800/0x8109266df35cafe3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cafdc expref: 16 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607525.968412:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff974582050600/0x8109266df35cafff lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607525.968452:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff974582051800/0x8109266df35cafe3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8109266df35cafdc expref: 16 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607525.968483:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff974582051800/0x8109266df35cafe3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8109266df35cafdc expref: 16 pid: 5795 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607525.968499:0:5797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d462d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5797:1869199364339328:0@lo:104: 00000100:00100000:3.0:1782607525.968568:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782607525.968828:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9745585acc00/0x8109266df35cafc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8109266df35cafb9 expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607525.968836:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9745585acc00/0x8109266df35cafc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8109266df35cafb9 expref: 16 pid: 5797 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607525.968845:0:5797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d462680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5797:1869199364339456:0@lo:104: 00010000:00010000:3.0:1782607525.968869:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff974540031e00/0x8109266df35cafa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8109266df35caf9d expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607525.968877:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff974540031e00/0x8109266df35cafa4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8109266df35caf9d expref: 16 pid: 5798 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607525.968885:0:5797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d463800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5797:1869199364339584:0@lo:104: 00010000:00010000:3.0:1782607525.968906:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff974582050c00/0x8109266df35caf7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8109266df35caf73 expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607525.968914:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff974582050c00/0x8109266df35caf7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8109266df35caf73 expref: 16 pid: 5798 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607525.968922:0:5797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d461500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5797:1869199364339712:0@lo:104: 00010000:00010000:3.0:1782607525.968956:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9745821d0000/0x8109266df35caf50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8109266df35caf49 expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607525.968972:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9745821d0000/0x8109266df35caf50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8109266df35caf49 expref: 16 pid: 5798 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607525.968980:0:5797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580e53480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5797:1869199364339840:0@lo:104: 00000100:00100000:3.0:1782607525.969000:0:5797:0:(client.c:2701:ptlrpc_set_wait()) set ffff974578fe0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782607525.969430:0:5785:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1782607525.969451:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607525.969510:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607525.969562:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607525.969679:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364339328 00000100:00100000:2.0:1782607525.969687:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364339328 00000100:00100000:2.0:1782607525.969724:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364339456 00000100:00100000:2.0:1782607525.969726:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364339456 00000100:00100000:2.0:1782607525.969734:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364339584 00000100:00100000:2.0:1782607525.969736:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364339584 00000100:00100000:2.0:1782607525.969746:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782607525.969754:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97456dd90450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+5:5797:x1869199364339328:12345-0@lo:104: 00010000:00010000:2.0:1782607525.969808:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff974582051000/0x8109266df35cafdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cafe3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607525.969864:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782607525.969871:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97456dd90450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+5:5797:x1869199364339328:12345-0@lo:104: Request processed in 117us (1303us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607525.969878:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782607525.969919:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782607525.969925:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581539f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+4:5797:x1869199364339456:12345-0@lo:104: 00010000:00010000:2.0:1782607525.969932:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff974540030800/0x8109266df35cafb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cafc0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607525.969959:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782607525.969963:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581539f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+4:5797:x1869199364339456:12345-0@lo:104: Request processed in 39us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607525.969968:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782607525.969978:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782607525.969992:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458153aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+3:5797:x1869199364339584:12345-0@lo:104: 00010000:00010000:2.0:1782607525.969999:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff974582050400/0x8109266df35caf9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cafa4 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607525.970324:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1782607525.970338:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458153aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+3:5797:x1869199364339584:12345-0@lo:104: Request processed in 339us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607525.970344:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1782607525.970363:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1782607525.970369:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974582051000/0x8109266df35cafdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cafe3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607525.970377:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974582051000 already unused, calling callback (ffffffffc1db0c20) 10000000:00010000:2.0:1782607525.970382:0:5790:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974582051000/0x8109266df35cafdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x8109266df35cafe3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607525.970391:0:5790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974582051000/0x8109266df35cafdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x8109266df35cafe3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782607525.970399:0:5790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974582051000/0x8109266df35cafdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x8109266df35cafe3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782607525.970405:0:5790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782607525.970467:0:5790:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974582051000/0x8109266df35cafdc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cafe3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607525.970475:0:5790:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782607525.970493:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974582051000/0x8109266df35cafdc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cafe3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607525.970510:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974582051000/0x8109266df35cafdc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cafe3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607525.970524:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782607525.970527:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974540030800/0x8109266df35cafb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cafc0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607525.970532:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974540030800 already unused, calling callback (ffffffffc1db0c20) 10000000:00010000:2.0:1782607525.970536:0:5790:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974540030800/0x8109266df35cafb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8109266df35cafc0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607525.970543:0:5790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974540030800/0x8109266df35cafb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8109266df35cafc0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782607525.970549:0:5790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974540030800/0x8109266df35cafb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8109266df35cafc0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782607525.970554:0:5790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1782607525.970624:0:5797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d462d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5797:1869199364339328:0@lo:104: 00000100:00100000:3.0:1782607525.970632:0:5797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d462680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5797:1869199364339456:0@lo:104: 00000100:00100000:3.0:1782607525.970638:0:5797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d463800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5797:1869199364339584:0@lo:104: 00000100:00100000:0.0:1782607525.970853:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607525.970864:0:5785:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364339712 00000100:00100000:0.0:1782607525.970868:0:5785:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364339712 00000100:00100000:0.0:1782607525.970890:0:5785:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364339840 00000100:00100000:0.0:1782607525.970892:0:5785:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364339840 00000100:00100000:0.0:1782607525.970902:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782607525.970907:0:5785:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581538380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+4:5797:x1869199364339712:12345-0@lo:104: 00010000:00010000:0.0:1782607525.970916:0:5785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff974540031a00/0x8109266df35caf73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35caf7a expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607525.970949:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1782607525.970960:0:5785:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581538380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+4:5797:x1869199364339712:12345-0@lo:104: Request processed in 53us (1398us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607525.970965:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782607525.970978:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782607525.970983:0:5785:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581538a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+3:5797:x1869199364339840:12345-0@lo:104: 00010000:00010000:0.0:1782607525.970990:0:5785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff974582050a00/0x8109266df35caf49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35caf50 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607525.971025:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1782607525.971030:0:5785:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581538a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+3:5797:x1869199364339840:12345-0@lo:104: Request processed in 47us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607525.971035:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782607525.971062:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580c06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364339968:0@lo:103: 00000100:00100000:0.0:1782607525.971088:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607525.971124:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364339968 00000100:00100000:0.0:1782607525.971127:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364339968 00010000:00010000:0.0:1782607525.971141:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff974582051800/0x8109266df35cafe3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cafdc expref: 17 pid: 5795 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607525.971158:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782607525.971163:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581538000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fae11c6e-4506-4104-bb8c-df42498f7e08+17:3319:x1869199364339968:12345-0@lo:103: 00010000:00010000:0.0:1782607525.971172:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782607525.971177:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff974582051800/0x8109266df35cafe3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cafdc expref: 17 pid: 5795 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607525.971187:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff974582051800/0x8109266df35cafe3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8109266df35cafdc expref: 17 pid: 5795 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607525.971201:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974582051800/0x8109266df35cafe3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8109266df35cafdc expref: 17 pid: 5795 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607525.971230:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782607525.971253:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581538000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fae11c6e-4506-4104-bb8c-df42498f7e08+16:3319:x1869199364339968:12345-0@lo:103: Request processed in 90us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607525.971259:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782607525.971282:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580c06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364339968:0@lo:103: 00000100:00100000:0.0:1782607525.971301:0:5797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d461500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5797:1869199364339712:0@lo:104: 00000100:00100000:0.0:1782607525.971321:0:5797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580e53480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5797:1869199364339840:0@lo:104: 00010000:00010000:0.0:1782607525.971353:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff974582050600/0x8109266df35cafff lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607525.971928:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1782607525.972019:0:5790:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974540030800/0x8109266df35cafb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cafc0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607525.972028:0:5790:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782607525.972050:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974540030800/0x8109266df35cafb9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cafc0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607525.972057:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974540030800/0x8109266df35cafb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cafc0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607525.972068:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782607525.972078:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974540031a00/0x8109266df35caf73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35caf7a expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607525.972085:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974540031a00 already unused, calling callback (ffffffffc1db0c20) 10000000:00010000:2.0:1782607525.972089:0:5790:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974540031a00/0x8109266df35caf73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8109266df35caf7a expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607525.972096:0:5790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974540031a00/0x8109266df35caf73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8109266df35caf7a expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782607525.972102:0:5790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974540031a00/0x8109266df35caf73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8109266df35caf7a expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782607525.972108:0:5790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782607525.972120:0:5790:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974540031a00/0x8109266df35caf73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35caf7a expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607525.972126:0:5790:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782607525.972130:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974540031a00/0x8109266df35caf73 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35caf7a expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607525.972137:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974540031a00/0x8109266df35caf73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35caf7a expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607525.972146:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782607525.972150:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974582050a00/0x8109266df35caf49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35caf50 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607525.972156:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974582050a00 already unused, calling callback (ffffffffc1db0c20) 10000000:00010000:2.0:1782607525.972159:0:5790:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974582050a00/0x8109266df35caf49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8109266df35caf50 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607525.972174:0:5790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974582050a00/0x8109266df35caf49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8109266df35caf50 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782607525.972181:0:5790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974582050a00/0x8109266df35caf49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8109266df35caf50 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782607525.972185:0:5790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782607525.972195:0:5790:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974582050a00/0x8109266df35caf49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35caf50 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607525.972200:0:5790:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782607525.972206:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974582050a00/0x8109266df35caf49 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35caf50 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607525.972220:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974582050a00/0x8109266df35caf49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35caf50 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607525.972229:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607525.972231:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607525.972233:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782607525.972245:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580c07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fae11c6e-4506-4104-bb8c-df42498f7e08:3318:1869199364340352:0@lo:103: 00000100:00100000:2.0:1782607525.972281:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607525.972530:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580c05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fae11c6e-4506-4104-bb8c-df42498f7e08:3316:1869199364340096:0@lo:103: 00000100:00100000:2.0:1782607525.972555:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607525.972583:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782607525.972589:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580c06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fae11c6e-4506-4104-bb8c-df42498f7e08:3316:1869199364340224:0@lo:103: 00000100:00100000:2.0:1782607525.972675:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607525.972699:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364340352 00000100:00100000:2.0:1782607525.972710:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364340352 00010000:00010000:2.0:1782607525.972732:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9745821d0000/0x8109266df35caf50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35caf49 expref: 16 pid: 5798 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607525.972747:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364340096 00000100:00100000:2.0:1782607525.972749:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364340096 00010000:00010000:2.0:1782607525.972758:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9745585acc00/0x8109266df35cafc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cafb9 expref: 17 pid: 5797 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607525.972793:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364340224 00000100:00100000:2.0:1782607525.972797:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364340224 00010000:00010000:2.0:1782607525.972807:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff974582050c00/0x8109266df35caf7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35caf73 expref: 18 pid: 5798 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607525.972819:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782607525.972825:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580c06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+18:3318:x1869199364340352:12345-0@lo:103: 00010000:00010000:2.0:1782607525.972837:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782607525.972841:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9745821d0000/0x8109266df35caf50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35caf49 expref: 18 pid: 5798 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607525.972850:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9745821d0000/0x8109266df35caf50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8109266df35caf49 expref: 18 pid: 5798 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607525.972862:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9745821d0000/0x8109266df35caf50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8109266df35caf49 expref: 18 pid: 5798 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607525.972875:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782607525.972905:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580c06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+17:3318:x1869199364340352:12345-0@lo:103: Request processed in 79us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607525.972910:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782607525.972925:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782607525.972938:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580c05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+16:3316:x1869199364340096:12345-0@lo:103: 00010000:00010000:2.0:1782607525.972946:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782607525.972951:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9745585acc00/0x8109266df35cafc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cafb9 expref: 16 pid: 5797 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607525.972960:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9745585acc00/0x8109266df35cafc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8109266df35cafb9 expref: 16 pid: 5797 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607525.972970:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9745585acc00/0x8109266df35cafc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8109266df35cafb9 expref: 16 pid: 5797 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607525.972978:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782607525.973003:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580c05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+15:3316:x1869199364340096:12345-0@lo:103: Request processed in 66us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607525.973123:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782607525.973138:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782607525.973145:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580c05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+14:3316:x1869199364340224:12345-0@lo:103: 00010000:00010000:2.0:1782607525.973152:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782607525.973157:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff974582050c00/0x8109266df35caf7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35caf73 expref: 14 pid: 5798 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607525.973165:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff974582050c00/0x8109266df35caf7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8109266df35caf73 expref: 14 pid: 5798 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607525.973176:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974582050c00/0x8109266df35caf7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8109266df35caf73 expref: 14 pid: 5798 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607525.973185:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782607525.973207:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580c05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+13:3316:x1869199364340224:12345-0@lo:103: Request processed in 62us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607525.973426:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782607525.973455:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580c07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fae11c6e-4506-4104-bb8c-df42498f7e08:3318:1869199364340352:0@lo:103: 00000100:00100000:2.0:1782607525.973474:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580c06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fae11c6e-4506-4104-bb8c-df42498f7e08:3316:1869199364340224:0@lo:103: 00000100:00100000:2.0:1782607525.973480:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580c05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fae11c6e-4506-4104-bb8c-df42498f7e08:3316:1869199364340096:0@lo:103: 00010000:00010000:2.0:1782607525.973886:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607525.973889:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607525.973890:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607525.974179:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974582050400/0x8109266df35caf9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cafa4 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607525.974190:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974582050400 already unused, calling callback (ffffffffc1db0c20) 10000000:00010000:0.0:1782607525.974194:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974582050400/0x8109266df35caf9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8109266df35cafa4 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607525.974203:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974582050400/0x8109266df35caf9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8109266df35cafa4 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782607525.974218:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974582050400/0x8109266df35caf9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8109266df35cafa4 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782607525.974224:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782607525.974259:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974582050400/0x8109266df35caf9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cafa4 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607525.974276:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782607525.974291:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974582050400/0x8109266df35caf9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cafa4 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607525.974298:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974582050400/0x8109266df35caf9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cafa4 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607525.974449:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607525.974452:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607525.974453:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782607525.974458:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782607525.974470:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97458153ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fae11c6e-4506-4104-bb8c-df42498f7e08:3318:1869199364340480:0@lo:103: 00000100:00100000:0.0:1782607525.974505:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607525.974576:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364340480 00000100:00100000:2.0:1782607525.974581:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364340480 00010000:00010000:2.0:1782607525.974598:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff974540031e00/0x8109266df35cafa4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35caf9d expref: 13 pid: 5798 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607525.974722:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782607525.974729:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458153bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fae11c6e-4506-4104-bb8c-df42498f7e08+13:3318:x1869199364340480:12345-0@lo:103: 00010000:00010000:2.0:1782607525.974739:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782607525.974743:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff974540031e00/0x8109266df35cafa4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35caf9d expref: 13 pid: 5798 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607525.974754:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff974540031e00/0x8109266df35cafa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8109266df35caf9d expref: 13 pid: 5798 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607525.974787:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974540031e00/0x8109266df35cafa4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8109266df35caf9d expref: 13 pid: 5798 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607525.974801:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff974582050600/0x8109266df35cafff lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607525.974810:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974582050600/0x8109266df35cafff lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607525.974831:0:5789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff974582050600/0x8109266df35cafff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607525.974838:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff974582050600/0x8109266df35cafff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607525.974845:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff974582050600/0x8109266df35cafff lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607525.974852:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff974582050600/0x8109266df35cafff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607525.974857:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974582050600 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:2.0:1782607525.974861:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff974582050600/0x8109266df35cafff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607525.974868:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff974582050600/0x8109266df35cafff lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607525.974879:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff974582050600/0x8109266df35cafff lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607525.974887:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782607525.974911:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458153bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fae11c6e-4506-4104-bb8c-df42498f7e08+12:3318:x1869199364340480:12345-0@lo:103: Request processed in 183us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607525.974917:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782607525.974984:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97458153ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fae11c6e-4506-4104-bb8c-df42498f7e08:3318:1869199364340480:0@lo:103: 00010000:00010000:0.0:1782607525.975003:0:5797:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff974582050600/0x8109266df35cafff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607525.975020:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff974582050600/0x8109266df35cafff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607525.975027:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974582050600/0x8109266df35cafff lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1782607525.975039:0:5797:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1782607526.028025:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+11:7507:x1869199364339200:12345-0@lo:253: Request processed in 75511us (77513us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607526.028039:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782607526.028284:0:7507:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745508cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:7507:1869199364339200:0@lo:253: 10000000:01000000:3.0:1782607526.028300:0:7507:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1782607526.028304:0:7507:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782607526.028305:0:7507:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782607526.028377:0:7507:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782607526.028378:0:7507:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1782607526.028380:0:7507:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782607526.028381:0:7507:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782607526.028383:0:7507:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782607526.028384:0:7507:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1782607526.028386:0:7507:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782607526.028387:0:7507:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1782607526.028410:0:7507:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97457f5e0000 from lustre-OST0001 10000000:01000000:3.0:1782607526.028436:0:7507:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1782607526.028439:0:7507:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1782607526.028446:0:7507:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff974549e68000 local copy 10000000:01000000:3.0:1782607526.028451:0:7507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1782607526.028485:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974582051600/0x8109266df35cb006 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607526.028495:0:7507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.104@tcp lock: ffff974582051600/0x8109266df35cb006 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607526.028518:0:7507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974582051600/0x8109266df35cb006 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607526.028535:0:7507:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580e53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:7507:1869199364340608:0@lo:101: 00000100:00100000:3.0:1782607526.028568:0:7507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607526.028741:0:7507:0:(client.c:2701:ptlrpc_set_wait()) set ffff974578fe0840 going to sleep for 11 seconds 00000100:00100000:1.0:1782607526.028914:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364340608 00000100:00100000:1.0:1782607526.028920:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364340608 00000100:00100000:1.0:1782607526.028986:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1782607526.028994:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+11:7507:x1869199364340608:12345-0@lo:101: 00010000:00010000:1.0:1782607526.029006:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607526.029026:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9745821d1400/0x8109266df35cb00d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cb006 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607526.029142:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9745821d1400/0x8109266df35cb00d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cb006 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607526.029155:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9745821d1400/0x8109266df35cb00d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cb006 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607526.029171:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745821d1400, rc 0) 00000100:00100000:1.0:1782607526.029208:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+12:7507:x1869199364340608:12345-0@lo:101: Request processed in 215us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607526.029272:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1782607526.029351:0:7507:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580e53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:7507:1869199364340608:0@lo:101: 00010000:00010000:3.0:1782607526.029364:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974582051600/0x8109266df35cb006 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x8109266df35cb00d expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607526.029372:0:7507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974582051600/0x8109266df35cb006 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8109266df35cb00d expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607526.029465:0:7507:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580e53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:7507:1869199364340736:0@lo:501: 00000100:00100000:3.0:1782607526.029501:0:7507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607526.029733:0:7507:0:(client.c:2701:ptlrpc_set_wait()) set ffff974578fe0840 going to sleep for 11 seconds 00000100:00100000:0.0:1782607526.029839:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364340736 00000100:00100000:0.0:1782607526.029843:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364340736 00000100:00100000:0.0:1782607526.029864:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1782607526.029870:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+12:7507:x1869199364340736:12345-0@lo:501: 00000100:00100000:0.0:1782607526.030187:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+12:7507:x1869199364340736:12345-0@lo:501: Request processed in 316us (684us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782607526.030194:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1782607526.030404:0:7507:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580e53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:7507:1869199364340736:0@lo:501: 10000000:01000000:3.0:1782607526.030420:0:7507:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1782607526.030444:0:7507:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1782607526.030448:0:7507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974582051600/0x8109266df35cb006 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8109266df35cb00d expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607526.030457:0:7507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974582051600/0x8109266df35cb006 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8109266df35cb00d expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607526.030465:0:7507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff974582051600/0x8109266df35cb006 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8109266df35cb00d expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607526.030520:0:7507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1782607526.030538:0:7507:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97457f5e0000 10000000:01000000:3.0:1782607526.030543:0:7507:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1782607526.030548:0:7507:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1782607526.030551:0:7507:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782607526.030555:0:7507:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1782607526.030557:0:7507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1782607526.030674:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974582051a00/0x8109266df35cb014 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607526.030683:0:7507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974582051a00/0x8109266df35cb014 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607526.030692:0:7507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974582051a00/0x8109266df35cb014 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607526.030706:0:7507:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580e53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:7507:1869199364340864:0@lo:101: 00000100:00100000:3.0:1782607526.030734:0:7507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607526.030758:0:7507:0:(client.c:2701:ptlrpc_set_wait()) set ffff974578fe0780 going to sleep for 11 seconds 00000100:00100000:0.0:1782607526.030866:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364340864 00000100:00100000:0.0:1782607526.030870:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364340864 00000100:00100000:0.0:1782607526.030921:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1782607526.030928:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+12:7507:x1869199364340864:12345-0@lo:101: 00010000:00010000:0.0:1782607526.030936:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607526.030946:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974540031400/0x8109266df35cb01b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cb014 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607526.030962:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974540031400/0x8109266df35cb01b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cb014 expref: 13 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607526.030971:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974540031400/0x8109266df35cb01b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cb014 expref: 13 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607526.030979:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974540031400, rc 0) 00000100:00100000:0.0:1782607526.031016:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+13:7507:x1869199364340864:12345-0@lo:101: Request processed in 82us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607526.031021:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00010000:2.0:1782607526.031160:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782607526.031168:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974582051600/0x8109266df35cb006 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x8109266df35cb00d expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607526.031187:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974582051600 already unused, calling callback (ffffffffc1db0c20) 10000000:00010000:2.0:1782607526.031191:0:5790:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974582051600/0x8109266df35cb006 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x8109266df35cb00d expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607526.031200:0:5790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974582051600/0x8109266df35cb006 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x8109266df35cb00d expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782607526.031208:0:5790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974582051600/0x8109266df35cb006 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x8109266df35cb00d expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782607526.031222:0:5790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1782607526.031400:0:7507:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580e53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:7507:1869199364340864:0@lo:101: 00010000:00010000:3.0:1782607526.031412:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974582051a00/0x8109266df35cb014 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb01b expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607526.031419:0:7507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974582051a00/0x8109266df35cb014 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cb01b expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607526.031484:0:7507:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580e53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:7507:1869199364340992:0@lo:501: 00000100:00100000:3.0:1782607526.031517:0:7507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607526.031589:0:7507:0:(client.c:2701:ptlrpc_set_wait()) set ffff974578fe0780 going to sleep for 11 seconds 00000100:00100000:1.0:1782607526.031745:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364340992 00000100:00100000:1.0:1782607526.031749:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364340992 00000100:00100000:1.0:1782607526.031800:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1782607526.031807:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+13:7507:x1869199364340992:12345-0@lo:501: 00000100:00100000:1.0:1782607526.031982:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+13:7507:x1869199364340992:12345-0@lo:501: Request processed in 176us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607526.031989:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00010000:1.0:1782607526.032028:0:5790:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974582051600/0x8109266df35cb006 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8109266df35cb00d expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607526.032036:0:5790:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1782607526.032181:0:7507:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580e53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:7507:1869199364340992:0@lo:501: 00000100:00100000:3.0:1782607526.032206:0:7507:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580e53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:7507:1869199364341248:0@lo:503: 00000100:00100000:3.0:1782607526.032256:0:7507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607526.032275:0:7507:0:(client.c:2701:ptlrpc_set_wait()) set ffff974578fe0780 going to sleep for 11 seconds 00010000:00010000:1.0:1782607526.032439:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974582051600/0x8109266df35cb006 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8109266df35cb00d expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607526.032446:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974582051600/0x8109266df35cb006 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8109266df35cb00d expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607526.032460:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607526.032462:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607526.032465:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607526.032474:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364341248 00000100:00100000:1.0:1782607526.032477:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364341248 00000100:00100000:1.0:1782607526.032495:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782607526.032500:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+13:7507:x1869199364341248:12345-0@lo:503: 00000100:00100000:1.0:1782607526.032752:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+13:7507:x1869199364341248:12345-0@lo:503: Request processed in 250us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607526.032758:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1782607526.032843:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745508cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fae11c6e-4506-4104-bb8c-df42498f7e08:3316:1869199364341120:0@lo:103: 00000100:00100000:3.0:1782607526.032870:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607526.032917:0:7507:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580e53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:7507:1869199364341248:0@lo:503: 00000040:00080000:3.0:1782607526.033290:0:7507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782607526.033488:0:7507:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580e53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:7507:1869199364341376:0@lo:502: 00000100:00100000:3.0:1782607526.033526:0:7507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607526.033539:0:7507:0:(client.c:2701:ptlrpc_set_wait()) set ffff974578fe0780 going to sleep for 11 seconds 00000100:00100000:1.0:1782607526.033718:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364341120 00000100:00100000:1.0:1782607526.033723:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364341120 00000100:00100000:1.0:1782607526.033791:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782607526.033798:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+13:3316:x1869199364341120:12345-0@lo:103: 00010000:00010000:1.0:1782607526.033809:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782607526.033827:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9745821d1400/0x8109266df35cb00d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8109266df35cb006 expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607526.033841:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782607526.033872:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+12:3316:x1869199364341120:12345-0@lo:103: Request processed in 75us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607526.033877:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782607526.033902:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745508cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fae11c6e-4506-4104-bb8c-df42498f7e08:3316:1869199364341120:0@lo:103: 00000100:00100000:1.0:1782607526.033923:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364341376 00000100:00100000:1.0:1782607526.033925:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364341376 00000100:00100000:1.0:1782607526.033940:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1782607526.033945:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+12:7507:x1869199364341376:12345-0@lo:502: 00000100:00100000:1.0:1782607526.034205:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+12:7507:x1869199364341376:12345-0@lo:502: Request processed in 259us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607526.034221:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1782607526.034490:0:7507:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580e53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:7507:1869199364341376:0@lo:502: 00000040:00080000:3.0:1782607526.034856:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1782607526.034901:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1782607526.034928:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1782607526.034964:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1782607526.034993:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1782607526.035179:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1782607526.035211:0:7507:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580e53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:7507:1869199364341504:0@lo:502: 00000100:00100000:3.0:1782607526.035265:0:7507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607526.035422:0:7507:0:(client.c:2701:ptlrpc_set_wait()) set ffff974578fe0780 going to sleep for 11 seconds 00000100:00100000:2.0:1782607526.035599:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364341504 00000100:00100000:2.0:1782607526.035669:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364341504 00000100:00100000:0.0:1782607526.035760:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1782607526.035894:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+12:7507:x1869199364341504:12345-0@lo:502: 00000100:00100000:0.0:1782607526.036192:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+12:7507:x1869199364341504:12345-0@lo:502: Request processed in 301us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607526.036200:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1782607526.036305:0:7507:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580e53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:7507:1869199364341504:0@lo:502: 00000040:00080000:3.0:1782607526.036489:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1782607526.036499:0:7507:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1782607526.037418:0:7515:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1782607526.037426:0:7515:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1782607526.037433:0:7515:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782607526.037435:0:7515:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1782607526.037449:0:7515:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782607526.037464:0:7515:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff974581508000) 00000020:00000080:1.0:1782607526.037484:0:7515:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1782607526.037490:0:7515:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1782607526.037547:0:7515:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97457f5e0000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1782607526.037555:0:7515:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1782607526.037562:0:7515:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8109266df35cb029 00010000:00010000:0.0:1782607526.046737:0:7515:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1782607526.047554:0:7515:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1782607526.055744:0:7515:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1782607526.057169:0:7515:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1782607526.063161:0:7515:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1782607526.064061:0:7515:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1782607526.065823:0:7515:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1782607526.065833:0:7515:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782607526.065839:0:7515:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782607526.065841:0:7515:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1782607526.065844:0:7515:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782607526.065847:0:7515:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782607526.065848:0:7515:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782607526.065851:0:7515:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782607526.065852:0:7515:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1782607526.065901:0:7515:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782607526.065904:0:7515:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782607526.065906:0:7515:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1782607526.065909:0:7515:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1782607526.066051:0:7507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1782607526.066072:0:7507:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1782607526.066093:0:7507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974582051a00/0x8109266df35cb014 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb01b expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607526.066106:0:7507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974582051a00/0x8109266df35cb014 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb01b expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782607526.066114:0:7507:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff97457f5e0000 from 1 10000000:01000000:2.0:1782607526.066116:0:7507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782607526.066148:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9745585acc00/0x8109266df35cb030 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607526.066156:0:7507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff9745585acc00/0x8109266df35cb030 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607526.066167:0:7507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff9745585acc00/0x8109266df35cb030 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607526.066196:0:7507:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580c05880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:7507:1869199364341632:0@lo:101: 00000100:00100000:2.0:1782607526.066268:0:7507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607526.066297:0:7507:0:(client.c:2701:ptlrpc_set_wait()) set ffff97457f927540 going to sleep for 11 seconds 00000100:00100000:0.0:1782607526.066678:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364341632 00000100:00100000:0.0:1782607526.066686:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364341632 00000100:00100000:0.0:1782607526.066730:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1782607526.066739:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+12:7507:x1869199364341632:12345-0@lo:101: 00010000:00010000:0.0:1782607526.066752:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607526.066783:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974540030000/0x8109266df35cb037 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cb030 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607526.066807:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974540030000/0x8109266df35cb037 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cb030 expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607526.066816:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974540030000/0x8109266df35cb037 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cb030 expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607526.066825:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974540030000, rc 0) 00000100:00100000:0.0:1782607526.066868:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+13:7507:x1869199364341632:12345-0@lo:101: Request processed in 129us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607526.066875:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1782607526.067033:0:7507:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580c05880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:7507:1869199364341632:0@lo:101: 00010000:00010000:2.0:1782607526.067129:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff9745585acc00/0x8109266df35cb030 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb037 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607526.067140:0:7507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff9745585acc00/0x8109266df35cb030 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cb037 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607526.067231:0:7507:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580c05880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:7507:1869199364341760:0@lo:501: 00000100:00100000:2.0:1782607526.067261:0:7507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607526.067290:0:7507:0:(client.c:2701:ptlrpc_set_wait()) set ffff97457f927540 going to sleep for 11 seconds 00000100:00100000:0.0:1782607526.067444:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364341760 00000100:00100000:0.0:1782607526.067449:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364341760 00000100:00100000:0.0:1782607526.067479:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1782607526.067487:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+13:7507:x1869199364341760:12345-0@lo:501: 00000100:00100000:0.0:1782607526.067837:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+13:7507:x1869199364341760:12345-0@lo:501: Request processed in 351us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607526.067845:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1782607526.067878:0:7507:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580c05880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:7507:1869199364341760:0@lo:501: 00000100:00100000:0.0:1782607526.067906:0:7507:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97458153ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:7507:1869199364341888:0@lo:503: 00000100:00100000:0.0:1782607526.067939:0:7507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607526.067955:0:7507:0:(client.c:2701:ptlrpc_set_wait()) set ffff974546785240 going to sleep for 11 seconds 00000100:00100000:2.0:1782607526.069921:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364341888 00000100:00100000:2.0:1782607526.069932:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364341888 00000100:00100000:2.0:1782607526.069983:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1782607526.069992:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974550829850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+13:7507:x1869199364341888:12345-0@lo:503: 00000100:00100000:2.0:1782607526.070747:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974550829850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+13:7507:x1869199364341888:12345-0@lo:503: Request processed in 754us (2804us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607526.070756:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1782607526.071525:0:7507:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97458153ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:7507:1869199364341888:0@lo:503: 00000040:00080000:0.0:1782607526.072562:0:7507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782607526.072760:0:7507:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97458153ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:7507:1869199364342016:0@lo:502: 00000100:00100000:0.0:1782607526.072845:0:7507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607526.072875:0:7507:0:(client.c:2701:ptlrpc_set_wait()) set ffff974546785240 going to sleep for 11 seconds 00000100:00100000:2.0:1782607526.072977:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364342016 00000100:00100000:2.0:1782607526.072984:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364342016 00000100:00100000:2.0:1782607526.073037:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1782607526.073165:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974550829050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+13:7507:x1869199364342016:12345-0@lo:502: 00000100:00100000:2.0:1782607526.073417:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974550829050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+13:7507:x1869199364342016:12345-0@lo:502: Request processed in 253us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607526.073528:0:7507:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97458153ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:7507:1869199364342016:0@lo:502: 00000040:00080000:3.0:1782607526.073801:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1782607526.073845:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1782607526.073868:0:7507:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580e53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:7507:1869199364342144:0@lo:502: 00000100:00100000:3.0:1782607526.073910:0:7507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607526.073929:0:7507:0:(client.c:2701:ptlrpc_set_wait()) set ffff974578fe0780 going to sleep for 11 seconds 00000100:00100000:1.0:1782607526.076831:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364342144 00000100:00100000:1.0:1782607526.076843:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364342144 00000100:00100000:2.0:1782607526.077861:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1782607526.082810:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1782607526.082827:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+13:7507:x1869199364342144:12345-0@lo:502: 00000100:00100000:1.0:1782607526.083068:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+13:7507:x1869199364342144:12345-0@lo:502: Request processed in 246us (9157us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607526.083076:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1782607526.083179:0:7507:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580e53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:7507:1869199364342144:0@lo:502: 00000040:00080000:3.0:1782607526.083530:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1782607526.083545:0:7507:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1782607526.084088:0:7519:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782607526.084098:0:7519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782607526.084100:0:7519:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1782607526.084106:0:7519:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff97457f5e0000 00000020:00000080:2.0:1782607526.084109:0:7519:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1782607526.084124:0:7519:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782607526.084126:0:7519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782607526.084127:0:7519:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1782607526.084130:0:7519:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1782607526.084408:0:7507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1782607526.084429:0:7507:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782607526.084448:0:7507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9745585acc00/0x8109266df35cb030 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb037 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607526.084459:0:7507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff9745585acc00/0x8109266df35cb030 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb037 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782607526.084494:0:7507:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1782607526.084497:0:7507:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97457f5e0000 10000000:01000000:3.0:1782607526.084499:0:7507:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97457f5e0000 10000000:01000000:3.0:1782607526.084503:0:7507:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782607526.084508:0:7507:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff97457f5e0000 from 1 10000000:01000000:3.0:1782607526.084510:0:7507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782607526.084541:0:7507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974582050000/0x8109266df35cb03e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607526.084549:0:7507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974582050000/0x8109266df35cb03e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607526.084560:0:7507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974582050000/0x8109266df35cb03e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607526.084596:0:7507:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580e53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:7507:1869199364342272:0@lo:101: 00000100:00100000:3.0:1782607526.084651:0:7507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607526.084953:0:7507:0:(client.c:2701:ptlrpc_set_wait()) set ffff974578fe0780 going to sleep for 11 seconds 00000100:00100000:0.0:1782607526.085019:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364342272 00000100:00100000:0.0:1782607526.085026:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364342272 00000100:00100000:0.0:1782607526.085064:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1782607526.085072:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+13:7507:x1869199364342272:12345-0@lo:101: 00010000:00010000:0.0:1782607526.085084:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607526.085096:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974540031e00/0x8109266df35cb045 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cb03e expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607526.085129:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974540031e00/0x8109266df35cb045 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cb03e expref: 14 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607526.085138:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974540031e00/0x8109266df35cb045 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cb03e expref: 14 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607526.085147:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974540031e00, rc 0) 00000100:00100000:0.0:1782607526.085186:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+14:7507:x1869199364342272:12345-0@lo:101: Request processed in 114us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607526.085192:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1782607526.085351:0:7507:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580e53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:7507:1869199364342272:0@lo:101: 00010000:00010000:3.0:1782607526.085364:0:7507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974582050000/0x8109266df35cb03e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb045 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607526.085372:0:7507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974582050000/0x8109266df35cb03e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cb045 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607526.085441:0:7507:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580e53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:7507:1869199364342400:0@lo:501: 00000100:00100000:3.0:1782607526.085466:0:7507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607526.085476:0:7507:0:(client.c:2701:ptlrpc_set_wait()) set ffff974578fe0780 going to sleep for 11 seconds 00000100:00100000:0.0:1782607526.085556:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364342400 00000100:00100000:0.0:1782607526.085559:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364342400 00000100:00100000:0.0:1782607526.085675:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1782607526.085682:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974550829450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+14:7507:x1869199364342400:12345-0@lo:501: 00000100:00100000:0.0:1782607526.085905:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974550829450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+14:7507:x1869199364342400:12345-0@lo:501: Request processed in 223us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607526.085912:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1782607526.085994:0:7507:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580e53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:7507:1869199364342400:0@lo:501: 00000100:00100000:3.0:1782607526.086019:0:7507:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580e53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:7507:1869199364342528:0@lo:503: 00000100:00100000:3.0:1782607526.086060:0:7507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607526.086077:0:7507:0:(client.c:2701:ptlrpc_set_wait()) set ffff974578fe0780 going to sleep for 11 seconds 00000100:00100000:1.0:1782607526.086219:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364342528 00000100:00100000:1.0:1782607526.086224:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364342528 00000100:00100000:1.0:1782607526.086244:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1782607526.086250:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+14:7507:x1869199364342528:12345-0@lo:503: 00000100:00100000:1.0:1782607526.086916:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+14:7507:x1869199364342528:12345-0@lo:503: Request processed in 663us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607526.086923:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1782607526.087233:0:7507:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580e53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:7507:1869199364342528:0@lo:503: 00000040:00080000:3.0:1782607526.087759:0:7507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782607526.087852:0:7507:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580e53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:7507:1869199364342656:0@lo:502: 00000100:00100000:3.0:1782607526.087896:0:7507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607526.087924:0:7507:0:(client.c:2701:ptlrpc_set_wait()) set ffff974578fe0780 going to sleep for 11 seconds 00010000:00010000:0.0:1782607526.087992:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607526.088137:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364342656 00000100:00100000:1.0:1782607526.088142:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364342656 00000100:00100000:1.0:1782607526.088178:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1782607526.088184:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974550828850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+14:7507:x1869199364342656:12345-0@lo:502: 00000100:00100000:1.0:1782607526.088534:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974550828850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+14:7507:x1869199364342656:12345-0@lo:502: Request processed in 349us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607526.088542:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1782607526.088722:0:7507:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580e53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:7507:1869199364342656:0@lo:502: 00000040:00080000:3.0:1782607526.089300:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1782607526.089447:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1782607526.089480:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1782607526.089526:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1782607526.089564:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1782607526.089690:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1782607526.089724:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1782607526.089751:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1782607526.089824:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1782607526.089855:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1782607526.089883:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1782607526.089920:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1782607526.089965:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1782607526.089997:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1782607526.090061:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1782607526.090093:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1782607526.090119:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1782607526.090167:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1782607526.090198:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1782607526.090301:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1782607526.090440:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1782607526.090476:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1782607526.090508:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1782607526.090564:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1782607526.090601:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1782607526.090801:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1782607526.090850:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1782607526.090881:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1782607526.090907:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1782607526.090943:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1782607526.090970:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1782607526.090996:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1782607526.091021:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1782607526.091373:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1782607526.091425:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1782607526.091469:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1782607526.091516:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1782607526.091561:0:7507:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580e53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:7507:1869199364342784:0@lo:502: 00000100:00100000:3.0:1782607526.091854:0:7507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607526.091934:0:7507:0:(client.c:2701:ptlrpc_set_wait()) set ffff974578fe0780 going to sleep for 11 seconds 00000100:00100000:1.0:1782607526.092167:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364342784 00000100:00100000:1.0:1782607526.092180:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364342784 00000100:00100000:1.0:1782607526.092397:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1782607526.092408:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+14:7507:x1869199364342784:12345-0@lo:502: 00000100:00100000:1.0:1782607526.092688:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+14:7507:x1869199364342784:12345-0@lo:502: Request processed in 281us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607526.092696:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1782607526.092981:0:7507:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580e53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:7507:1869199364342784:0@lo:502: 00000040:00080000:3.0:1782607526.093076:0:7507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1782607526.093087:0:7507:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1782607526.093999:0:7520:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1782607526.094034:0:7520:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9745775719c0) 00000020:00000080:3.0:1782607526.094062:0:7520:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1782607526.094238:0:7520:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97457f5e0000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1782607526.094242:0:7520:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97457f5e0000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1782607526.094245:0:7520:0:(obd_mount.c:701:lustre_put_lsi()) put ffff97457f5e0000 3 00010000:00080000:3.0:1782607526.094273:0:7520:0:(ldlm_lib.c:102:import_set_conn()) imp ffff974550539000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.104@tcp at head 00010000:00010000:3.0:1782607526.096908:0:7520:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1782607526.097195:0:7520:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1782607526.097293:0:7520:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1782607526.097305:0:7520:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x8109266df35cb053 00000100:00080000:3.0:1782607526.097387:0:7520:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782607526.097393:0:7520:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff974550539000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1782607526.097427:0:7520:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff974580e53800 x1869199364342912/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782607526.097492:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580e53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3315:1869199364342912:0@lo:38: 00000100:00100000:1.0:1782607526.097556:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607526.097683:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364342912 00000100:00100000:0.0:1782607526.097690:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364342912 00000100:00100000:0.0:1782607526.097722:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782607526.097729:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3315:x1869199364342912:12345-0@lo:38: 00010000:00080000:0.0:1782607526.097750:0:5805:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 184 last 0 00000020:00000080:0.0:1782607526.097799:0:5805:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x8109266df35cb05a 00000004:00100000:0.0:1782607526.097813:0:5805:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1782607526.097840:0:5805:0:(import.c:65:import_set_state_nolock()) ffff97457fb87000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1782607526.097945:0:7520:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000040:00080000:3.0:1782607526.098149:0:7520:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:3.0:1782607526.098275:0:7521:0:(client.c:1831:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff974580e50700 x1869199364343040/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607526.098294:0:7521:0:(client.c:2701:ptlrpc_set_wait()) set ffff974578fe09c0 going to sleep for 0 seconds 00000100:00100000:2.0:1782607526.098833:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782607526.098845:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580c06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869199364343168:0@lo:400: 00000100:00100000:2.0:1782607526.098882:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607526.098913:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580c05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364343424:0@lo:400: 00000100:00100000:2.0:1782607526.098942:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607526.098960:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782607526.098966:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580c07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3319:1869199364343296:0@lo:400: 00000100:00100000:2.0:1782607526.098986:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607526.099011:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364343168 00000100:00100000:2.0:1782607526.099027:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364343168 00000100:00100000:2.0:1782607526.099052:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364343296 00000100:00100000:2.0:1782607526.099055:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364343296 00000100:00100000:2.0:1782607526.099080:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782607526.099087:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580c06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869199364343168:12345-0@lo:400: 00000100:00100000:2.0:1782607526.099130:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580c06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869199364343168:12345-0@lo:400: Request processed in 42us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607526.099137:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782607526.099151:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782607526.099166:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580c04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1869199364343296:12345-0@lo:400: 00000100:00100000:2.0:1782607526.099200:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580c04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1869199364343296:12345-0@lo:400: Request processed in 35us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607526.099206:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782607526.099237:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364343424 00000100:00100000:2.0:1782607526.099241:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364343424 00000100:00100000:2.0:1782607526.099268:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782607526.099275:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580c04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364343424:12345-0@lo:400: 00000100:00100000:2.0:1782607526.099304:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580c04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364343424:12345-0@lo:400: Request processed in 30us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607526.099322:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1782607526.099362:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974580c06a00 x1869199364343168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782607542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782607526.099376:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580c06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869199364343168:0@lo:400: 00010000:00080000:2.0:1782607526.099403:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974580c07100 x1869199364343296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782607542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782607526.099411:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580c07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3319:1869199364343296:0@lo:400: 00010000:00080000:2.0:1782607526.099419:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974580c05880 x1869199364343424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782607526.099427:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580c05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364343424:0@lo:400: 00000020:01000000:2.0:1782607526.101859:0:7507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1782607526.101894:0:7507:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782607526.101924:0:7507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974582050000/0x8109266df35cb03e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb045 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607526.101947:0:7507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974582050000/0x8109266df35cb03e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb045 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1782607526.102000:0:7507:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1782607526.102002:0:7507:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782607526.102003:0:7507:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782607526.102004:0:7507:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782607526.102006:0:7507:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782607526.102007:0:7507:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782607526.102017:0:7507:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782607526.102019:0:7507:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782607526.102020:0:7507:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782607526.102022:0:7507:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782607526.102023:0:7507:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782607526.102027:0:7507:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1782607526.102029:0:7507:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782607526.102031:0:7507:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782607526.102032:0:7507:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782607526.102033:0:7507:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782607526.102034:0:7507:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782607526.102035:0:7507:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782607526.102036:0:7507:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782607526.102038:0:7507:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782607526.102039:0:7507:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782607526.102040:0:7507:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782607526.102041:0:7507:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782607526.102066:0:7507:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1782607526.102083:0:7507:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580c05880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:7507:1869199364343552:0@lo:253: 00000100:00100000:2.0:1782607526.102139:0:7507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607526.102168:0:7507:0:(client.c:2701:ptlrpc_set_wait()) set ffff97457f927f00 going to sleep for 11 seconds 00000100:00100000:2.0:1782607526.102185:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364343552 00000100:00100000:2.0:1782607526.102191:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364343552 00000100:00100000:0.0:1782607526.102400:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869199364342912:12345-0@lo:38: Request processed in 4669us (4842us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607526.102409:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1782607526.102449:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782607526.102453:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782607526.102653:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1782607526.102664:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974550828450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+14:7507:x1869199364343552:12345-0@lo:253: 20000000:01000000:2.0:1782607526.102705:0:5795:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1782607526.102717:0:5795:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:1.0:1782607526.102852:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974580e53800 x1869199364342912/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782607536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607526.102862:0:3315:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1782607526.102869:0:3315:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1782607526.102876:0:3315:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1782607526.102881:0:3315:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1782607526.102884:0:3315:0:(import.c:65:import_set_state_nolock()) ffff974550539000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1782607526.102891:0:3315:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000e02f6a52): req@ffff974580e50700 x1869199364343040/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607526.107259:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580e53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3315:1869199364342912:0@lo:38: 00000100:00100000:3.0:1782607526.107504:0:7521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607526.107534:0:7521:0:(client.c:2701:ptlrpc_set_wait()) set ffff974578fe09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782607526.107694:0:5814:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364343040 00000100:00100000:1.0:1782607526.107702:0:5814:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364343040 00000100:00100000:1.0:1782607526.107755:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782607526.107762:0:5814:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580e50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7521:x1869199364343040:12345-0@lo:901: 00000100:00100000:1.0:1782607526.108449:0:5814:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580e50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7521:x1869199364343040:12345-0@lo:901: Request processed in 684us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607526.108457:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1782607526.108582:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1782607526.112746:0:7521:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974580e50700 x1869199364343040/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1782607542 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607526.112780:0:7521:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580e50700 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7521:1869199364343040:0@lo:901: 20000000:01000000:2.0:1782607526.141793:0:5795:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1782607526.141813:0:5795:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1782607526.141868:0:5819:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1782607526.141874:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1782607526.141895:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff974540031a00/0x8109266df35cb061 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607526.141913:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9745585ac000/0x8109266df35cafb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cafab expref: 14 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607526.141922:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff974540031a00/0x8109266df35cb061 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607526.141962:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9745585ac000/0x8109266df35cafb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8109266df35cafab expref: 14 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607526.141977:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9745585ac000/0x8109266df35cafb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8109266df35cafab expref: 14 pid: 5798 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607526.141991:0:5819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581539c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5819:1869199364343680:0@lo:104: 00000100:00100000:0.0:1782607526.142067:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607526.142113:0:5819:0:(client.c:2701:ptlrpc_set_wait()) set ffff97457f923d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782607526.142229:0:5785:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364343680 00000100:00100000:2.0:1782607526.142236:0:5785:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364343680 00000100:00100000:2.0:1782607526.142289:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782607526.142298:0:5785:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458153a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+3:5819:x1869199364343680:12345-0@lo:104: 00010000:00010000:2.0:1782607526.142318:0:5785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff974540031200/0x8109266df35cafab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cafb2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607526.142376:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782607526.142382:0:5785:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458153a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+3:5819:x1869199364343680:12345-0@lo:104: Request processed in 86us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607526.142389:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1782607526.142623:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782607526.142629:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974540031200/0x8109266df35cafab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cafb2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607526.142637:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974540031200 already unused, calling callback (ffffffffc1db0c20) 10000000:00010000:0.0:1782607526.142640:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974540031200/0x8109266df35cafab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8109266df35cafb2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607526.142660:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974540031200/0x8109266df35cafab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8109266df35cafb2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782607526.142666:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974540031200/0x8109266df35cafab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8109266df35cafb2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782607526.142671:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1782607526.142708:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974540031200/0x8109266df35cafab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cafb2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607526.142714:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782607526.142733:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974540031200/0x8109266df35cafab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cafb2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607526.142740:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974540031200/0x8109266df35cafab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cafb2 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607526.142761:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607526.142789:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607526.142791:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782607526.142802:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97458153b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fae11c6e-4506-4104-bb8c-df42498f7e08:3316:1869199364343808:0@lo:103: 00000100:00100000:0.0:1782607526.142835:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607526.142869:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364343808 00000100:00100000:0.0:1782607526.142873:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364343808 00010000:00010000:0.0:1782607526.142891:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9745585ac000/0x8109266df35cafb2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cafab expref: 15 pid: 5798 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607526.142913:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782607526.142920:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974548804450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+15:3316:x1869199364343808:12345-0@lo:103: 00010000:00010000:0.0:1782607526.142937:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782607526.142942:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9745585ac000/0x8109266df35cafb2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cafab expref: 15 pid: 5798 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607526.142953:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9745585ac000/0x8109266df35cafb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8109266df35cafab expref: 15 pid: 5798 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607526.142968:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff974540031a00/0x8109266df35cb061 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607526.142976:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974540031a00/0x8109266df35cb061 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1782607526.142989:0:5787:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001116344s 00010000:00010000:0.0:1782607526.142994:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff974540031a00/0x8109266df35cb061 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607526.143000:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff974540031a00/0x8109266df35cb061 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607526.143006:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff974540031a00/0x8109266df35cb061 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607526.143023:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff974540031a00/0x8109266df35cb061 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607526.143028:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974540031a00 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:0.0:1782607526.143032:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff974540031a00/0x8109266df35cb061 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607526.143038:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff974540031a00/0x8109266df35cb061 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607526.143053:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff974540031a00/0x8109266df35cb061 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607526.143063:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782607526.143090:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974548804450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+15:3316:x1869199364343808:12345-0@lo:103: Request processed in 171us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607526.143096:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782607526.143156:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97458153b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fae11c6e-4506-4104-bb8c-df42498f7e08:3316:1869199364343808:0@lo:103: 00010000:00010000:0.0:1782607526.143182:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9745585ac000/0x8109266df35cafb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8109266df35cafab expref: 14 pid: 5798 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607526.143191:0:5819:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581539c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5819:1869199364343680:0@lo:104: 00010000:00010000:0.0:1782607526.143203:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff974540031a00/0x8109266df35cb061 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607526.143222:0:5819:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff974540031a00/0x8109266df35cb061 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607526.143228:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff974540031a00/0x8109266df35cb061 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607526.143234:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974540031a00/0x8109266df35cb061 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607526.149002:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974550828450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+13:7507:x1869199364343552:12345-0@lo:253: Request processed in 46331us (46853us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607526.149025:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1782607526.149168:0:7507:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580c05880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fae11c6e-4506-4104-bb8c-df42498f7e08:7507:1869199364343552:0@lo:253: 10000000:01000000:2.0:1782607526.149182:0:7507:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1782607526.149185:0:7507:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782607526.149187:0:7507:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782607526.149188:0:7507:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782607526.149190:0:7507:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782607526.149191:0:7507:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782607526.149192:0:7507:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782607526.149194:0:7507:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782607526.149196:0:7507:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782607526.149197:0:7507:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782607526.149198:0:7507:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782607526.149200:0:7507:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1782607526.149213:0:7507:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1782607526.155670:0:7507:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1782607526.155868:0:7507:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1782607526.156076:0:7507:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1782607526.156257:0:7507:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1782607526.156466:0:7507:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1782607526.156687:0:7507:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1782607526.160612:0:7507:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1782607526.435716:0:7507:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1782607526.435726:0:7507:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1782607526.435761:0:7507:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1782607526.435852:0:7507:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.104@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1782607526.435867:0:7507:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1782607526.435894:0:7507:0:(super25.c:188:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1782607527.110017:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607528.144593:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607529.156269:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607530.050232:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581539c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364343936:0@lo:13: 00000100:00100000:1.0:1782607530.050321:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607530.050526:0:6613:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364343936 00000100:00100000:0.0:1782607530.050540:0:6613:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364343936 00000100:00100000:0.0:1782607530.050607:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782607530.050617:0:6613:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364343936:12345-0@lo:13: 00002000:00000024:0.0:1782607530.050657:0:6613:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782607530.050705:0:6613:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364343936:12345-0@lo:13: Request processed in 90us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607530.050713:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1782607530.050817:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782607530.050849:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974581539c00 x1869199364343936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607546 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607530.050868:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581539c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364343936:0@lo:13: 00010000:00010000:2.0:1782607530.179023:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607531.202234:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782607531.586011:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580c07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1869199364344192:0@lo:400: 00000100:00100000:2.0:1782607531.586089:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607531.586150:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1782607531.586157:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580c05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364344064:0@lo:400: 00000100:00100000:2.0:1782607531.586188:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607531.586213:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580c04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1869199364344576:0@lo:400: 00000100:00100000:2.0:1782607531.586240:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607531.586268:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580c06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1869199364344320:0@lo:400: 00000100:00100000:2.0:1782607531.586303:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607531.586320:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782607531.586325:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580c07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364344448:0@lo:400: 00000100:00100000:2.0:1782607531.586350:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607531.586639:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364344192 00000100:00100000:2.0:1782607531.586648:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364344192 00000100:00100000:2.0:1782607531.586688:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364344576 00000100:00100000:2.0:1782607531.586691:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364344576 00000100:00100000:2.0:1782607531.586715:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364344320 00000100:00100000:2.0:1782607531.586718:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364344320 00000100:00100000:2.0:1782607531.586736:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782607531.586745:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580c04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1869199364344192:12345-0@lo:400: 00000100:00100000:2.0:1782607531.586827:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580c04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1869199364344192:12345-0@lo:400: Request processed in 82us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607531.586835:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782607531.586852:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782607531.586858:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580c07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1869199364344576:12345-0@lo:400: 00000100:00100000:2.0:1782607531.586885:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580c07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1869199364344576:12345-0@lo:400: Request processed in 28us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607531.586906:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782607531.586918:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782607531.586924:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580c05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869199364344320:12345-0@lo:400: 00000100:00100000:2.0:1782607531.586955:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580c05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869199364344320:12345-0@lo:400: Request processed in 32us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607531.586961:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782607531.586978:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364344064 00000100:00100000:2.0:1782607531.586981:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364344064 00000100:00100000:2.0:1782607531.587003:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1782607531.587009:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+13:3319:x1869199364344064:12345-0@lo:400: 00000100:00100000:2.0:1782607531.587035:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+13:3319:x1869199364344064:12345-0@lo:400: Request processed in 26us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607531.587040:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1782607531.587069:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1782607531.587104:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974580c06a00 x1869199364344320/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782607547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782607531.587118:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580c06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1869199364344320:0@lo:400: 00000100:00100000:2.0:1782607531.587337:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580c05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364344064:0@lo:400: 00010000:00080000:2.0:1782607531.587349:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974580c04380 x1869199364344576/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782607547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782607531.587358:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580c04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1869199364344576:0@lo:400: 00010000:00080000:2.0:1782607531.587366:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974580c07100 x1869199364344192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782607547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782607531.587374:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580c07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1869199364344192:0@lo:400: 00000100:00100000:0.0:1782607531.587817:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364344448 00000100:00100000:0.0:1782607531.587823:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364344448 00000100:00100000:0.0:1782607531.587859:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782607531.587867:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580c07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364344448:12345-0@lo:400: 00000100:00100000:0.0:1782607531.587914:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580c07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364344448:12345-0@lo:400: Request processed in 48us (1563us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607531.587921:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1782607531.587958:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974580c07800 x1869199364344448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782607531.587968:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580c07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364344448:0@lo:400: 00010000:00010000:0.0:1782607532.236940:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782607533.086316:0:7864:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1782607533.251592:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782607533.633896:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1782607533.633905:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff97455053f000 from 30 10000000:01000000:1.0:1782607533.633911:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782607533.633963:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9745821d1400/0x8109266df35cb068 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607533.633975:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff9745821d1400/0x8109266df35cb068 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607533.633987:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff9745821d1400/0x8109266df35cb068 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607533.634029:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745508ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364344704:0@lo:101: 00000100:00100000:1.0:1782607533.634124:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607533.634209:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff974580d8ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1782607533.634449:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364344704 00000100:00100000:0.0:1782607533.634458:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364344704 00000100:00100000:0.0:1782607533.634514:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1782607533.634524:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+13:5800:x1869199364344704:12345-0@lo:101: 00010000:00010000:0.0:1782607533.634539:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607533.634552:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974540031200/0x8109266df35cb06f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cb068 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607533.634575:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974540031200/0x8109266df35cb06f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cb068 expref: 14 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607533.634602:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974540031200/0x8109266df35cb06f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cb068 expref: 14 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607533.634611:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974540031200, rc 0) 00000100:00100000:0.0:1782607533.634657:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+14:5800:x1869199364344704:12345-0@lo:101: Request processed in 135us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607533.634663:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1782607533.635099:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745508ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364344704:0@lo:101: 00010000:00010000:1.0:1782607533.635113:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff9745821d1400/0x8109266df35cb068 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb06f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607533.635124:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff9745821d1400/0x8109266df35cb068 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cb06f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607533.635203:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745508ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364344832:0@lo:501: 00000100:00100000:1.0:1782607533.635232:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607533.635302:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff974580d8ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1782607533.635398:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364344832 00000100:00100000:0.0:1782607533.635403:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364344832 00000100:00100000:0.0:1782607533.635435:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1782607533.635442:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+14:5800:x1869199364344832:12345-0@lo:501: 00000100:00100000:0.0:1782607533.635702:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+14:5800:x1869199364344832:12345-0@lo:501: Request processed in 259us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607533.635709:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1782607533.635933:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745508ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364344832:0@lo:501: 00000100:00100000:1.0:1782607533.635964:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745508ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364344960:0@lo:503: 00000100:00100000:1.0:1782607533.636000:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607533.636193:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff974580d8ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1782607533.636688:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364344960 00000100:00100000:2.0:1782607533.636695:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364344960 00000100:00100000:3.0:1782607533.637117:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1782607533.637128:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974550829c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+14:5800:x1869199364344960:12345-0@lo:503: 00000100:00100000:3.0:1782607533.637438:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974550829c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+14:5800:x1869199364344960:12345-0@lo:503: Request processed in 311us (1436us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607533.637445:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1782607533.637526:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745508ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364344960:0@lo:503: 00000100:00100000:1.0:1782607533.638020:0:7886:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745508ca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:7886:1869199364345088:0@lo:502: 00000100:00100000:1.0:1782607533.638068:0:7886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607533.638445:0:7886:0:(client.c:2701:ptlrpc_set_wait()) set ffff974580d8acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782607533.638520:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364345088 00000100:00100000:0.0:1782607533.638527:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364345088 00000100:00100000:0.0:1782607533.638557:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1782607533.638564:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+14:7886:x1869199364345088:12345-0@lo:502: 00000100:00100000:0.0:1782607533.638961:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+14:7886:x1869199364345088:12345-0@lo:502: Request processed in 396us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607533.638969:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1782607533.639101:0:7886:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745508ca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:7886:1869199364345088:0@lo:502: 00000100:00100000:1.0:1782607533.639173:0:7886:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745508ca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:7886:1869199364345216:0@lo:502: 00000100:00100000:1.0:1782607533.639207:0:7886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607533.639411:0:7886:0:(client.c:2701:ptlrpc_set_wait()) set ffff974580d8acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782607533.639476:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364345216 00000100:00100000:3.0:1782607533.639487:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364345216 00000100:00100000:3.0:1782607533.639510:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1782607533.639518:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974550828c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+14:7886:x1869199364345216:12345-0@lo:502: 00000100:00100000:3.0:1782607533.639691:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974550828c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+14:7886:x1869199364345216:12345-0@lo:502: Request processed in 174us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607533.639698:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1782607533.639966:0:7886:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745508ca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:7886:1869199364345216:0@lo:502: 00000040:00080000:1.0:1782607533.639991:0:7886:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1782607533.640329:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1782607533.640352:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782607533.640363:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9745821d1400/0x8109266df35cb068 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb06f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607533.640376:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff9745821d1400/0x8109266df35cb068 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb06f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782607533.640386:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1782607533.640389:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1782607533.640392:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1782607533.640420:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974582050e00/0x8109266df35cb076 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607533.640429:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974582050e00/0x8109266df35cb076 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607533.640438:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974582050e00/0x8109266df35cb076 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607533.640454:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580e50700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364345344:0@lo:101: 00000100:00100000:3.0:1782607533.640489:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607533.640514:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745516703c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782607533.640526:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364345344 00000100:00100000:3.0:1782607533.640539:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364345344 00000100:00100000:3.0:1782607533.640562:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1782607533.640569:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974550828050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+14:5800:x1869199364345344:12345-0@lo:101: 00010000:00010000:3.0:1782607533.640579:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607533.640592:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974582051600/0x8109266df35cb07d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cb076 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607533.640618:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974582051600/0x8109266df35cb07d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cb076 expref: 15 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607533.640629:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974582051600/0x8109266df35cb07d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cb076 expref: 15 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607533.640638:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974582051600, rc 0) 00000100:00100000:3.0:1782607533.640667:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974550828050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+15:5800:x1869199364345344:12345-0@lo:101: Request processed in 98us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607533.640673:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1782607533.640706:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580e50700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364345344:0@lo:101: 00010000:00010000:3.0:1782607533.640718:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974582050e00/0x8109266df35cb076 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb07d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607533.640725:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974582050e00/0x8109266df35cb076 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cb07d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607533.641017:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580e50700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364345472:0@lo:501: 00000100:00100000:3.0:1782607533.641045:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607533.641064:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745516703c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782607533.641076:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364345472 00000100:00100000:3.0:1782607533.641080:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364345472 00000100:00100000:3.0:1782607533.641107:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1782607533.641113:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+15:5800:x1869199364345472:12345-0@lo:501: 00000100:00100000:3.0:1782607533.641531:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+15:5800:x1869199364345472:12345-0@lo:501: Request processed in 416us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607533.641538:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1782607533.641573:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580e50700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364345472:0@lo:501: 00000100:00100000:3.0:1782607533.641603:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580e50700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364345600:0@lo:503: 00000100:00100000:3.0:1782607533.641640:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607533.641653:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745516703c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782607533.641665:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364345600 00000100:00100000:3.0:1782607533.641668:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364345600 00000100:00100000:3.0:1782607533.641685:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1782607533.641690:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+15:5800:x1869199364345600:12345-0@lo:503: 00000100:00100000:3.0:1782607533.642526:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+15:5800:x1869199364345600:12345-0@lo:503: Request processed in 832us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607533.642535:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1782607533.642677:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580e50700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364345600:0@lo:503: 00000100:00100000:0.0:1782607533.643402:0:7887:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97458153b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:7887:1869199364345728:0@lo:502: 00000100:00100000:0.0:1782607533.643457:0:7887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607533.643532:0:7887:0:(client.c:2701:ptlrpc_set_wait()) set ffff97456a83f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782607533.643571:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364345728 00000100:00100000:2.0:1782607533.643577:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364345728 00000100:00100000:2.0:1782607533.643654:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1782607533.643663:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+15:7887:x1869199364345728:12345-0@lo:502: 00000100:00100000:2.0:1782607533.644353:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+15:7887:x1869199364345728:12345-0@lo:502: Request processed in 690us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607533.644362:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1782607533.644445:0:7887:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97458153b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:7887:1869199364345728:0@lo:502: 00000020:01000000:0.0:1782607533.644475:0:7887:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782607533.644489:0:7887:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782607533.644491:0:7887:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782607533.644497:0:7887:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782607533.644499:0:7887:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1782607533.644522:0:7887:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97458153b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:7887:1869199364345856:0@lo:502: 00000100:00100000:0.0:1782607533.644555:0:7887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607533.644696:0:7887:0:(client.c:2701:ptlrpc_set_wait()) set ffff97456a83f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782607533.645112:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364345856 00000100:00100000:3.0:1782607533.645119:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364345856 00000100:00100000:3.0:1782607533.645162:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1782607533.645170:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+15:7887:x1869199364345856:12345-0@lo:502: 00000100:00100000:3.0:1782607533.645359:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+15:7887:x1869199364345856:12345-0@lo:502: Request processed in 189us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607533.645366:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1782607533.645503:0:7887:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97458153b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:7887:1869199364345856:0@lo:502: 00000020:01000000:0.0:1782607533.645527:0:7887:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782607533.645533:0:7887:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782607533.645535:0:7887:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1782607533.645540:0:7887:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1782607533.645703:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1782607533.645721:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1782607533.645731:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974582050e00/0x8109266df35cb076 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb07d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607533.645975:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974582050e00/0x8109266df35cb076 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb07d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782607533.645985:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782607533.645987:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff974544151000 from 30 10000000:01000000:3.0:1782607533.645990:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782607533.646088:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974582050c00/0x8109266df35cb084 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607533.646096:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974582050c00/0x8109266df35cb084 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607533.646105:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974582050c00/0x8109266df35cb084 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607533.646121:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580e50a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364345984:0@lo:101: 00000100:00100000:3.0:1782607533.646218:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607533.646294:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745442e2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782607533.646399:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364345984 00000100:00100000:2.0:1782607533.646405:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364345984 00000100:00100000:0.0:1782607533.646481:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1782607533.646491:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+15:5800:x1869199364345984:12345-0@lo:101: 00010000:00010000:0.0:1782607533.646503:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607533.646515:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974540030800/0x8109266df35cb08b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cb084 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607533.646537:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974540030800/0x8109266df35cb08b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cb084 expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607533.646548:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974540030800/0x8109266df35cb08b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cb084 expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607533.646557:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974540030800, rc 0) 00000100:00100000:0.0:1782607533.646597:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+16:5800:x1869199364345984:12345-0@lo:101: Request processed in 108us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607533.646603:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1782607533.646676:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580e50a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364345984:0@lo:101: 00010000:00010000:3.0:1782607533.646688:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974582050c00/0x8109266df35cb084 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb08b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607533.646697:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974582050c00/0x8109266df35cb084 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cb08b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607533.646739:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580e50a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364346112:0@lo:501: 00000100:00100000:3.0:1782607533.646806:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607533.646837:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745442e2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782607533.647196:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364346112 00000100:00100000:0.0:1782607533.647205:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364346112 00000100:00100000:0.0:1782607533.647227:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1782607533.647233:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+16:5800:x1869199364346112:12345-0@lo:501: 00000100:00100000:0.0:1782607533.647499:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+16:5800:x1869199364346112:12345-0@lo:501: Request processed in 265us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607533.647506:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1782607533.649440:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580e50a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364346112:0@lo:501: 00000100:00100000:3.0:1782607533.649494:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580e50a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364346240:0@lo:503: 00000100:00100000:3.0:1782607533.649563:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607533.649606:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745442e2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782607533.652134:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364346240 00000100:00100000:0.0:1782607533.652156:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364346240 00000100:00100000:0.0:1782607533.652199:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1782607533.652208:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+16:5800:x1869199364346240:12345-0@lo:503: 00000100:00100000:0.0:1782607533.652460:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+16:5800:x1869199364346240:12345-0@lo:503: Request processed in 253us (2897us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607533.652469:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1782607533.652532:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580e50a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364346240:0@lo:503: 00000100:00100000:3.0:1782607533.666535:0:7888:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580e50000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:7888:1869199364346368:0@lo:502: 00000100:00100000:3.0:1782607533.666630:0:7888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607533.666675:0:7888:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745442e2000 going to sleep for 11 seconds 00000100:00100000:1.0:1782607533.667459:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364346368 00000100:00100000:1.0:1782607533.667469:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364346368 00000100:00100000:1.0:1782607533.667528:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1782607533.667539:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+16:7888:x1869199364346368:12345-0@lo:502: 00000100:00100000:1.0:1782607533.667967:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+16:7888:x1869199364346368:12345-0@lo:502: Request processed in 428us (1337us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607533.667986:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1782607533.668157:0:7888:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580e50000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:7888:1869199364346368:0@lo:502: 00000100:00100000:3.0:1782607533.668221:0:7888:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580e50000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:7888:1869199364346496:0@lo:502: 00000100:00100000:3.0:1782607533.668257:0:7888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607533.668302:0:7888:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745442e2000 going to sleep for 11 seconds 00000100:00100000:1.0:1782607533.669024:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364346496 00000100:00100000:1.0:1782607533.669031:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364346496 00000100:00100000:1.0:1782607533.669065:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1782607533.669072:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+16:7888:x1869199364346496:12345-0@lo:502: 00000100:00100000:1.0:1782607533.669278:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+16:7888:x1869199364346496:12345-0@lo:502: Request processed in 196us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607533.669285:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1782607533.669372:0:7888:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580e50000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:7888:1869199364346496:0@lo:502: 00000040:00080000:3.0:1782607533.669395:0:7888:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1782607533.669663:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1782607533.669684:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782607533.669695:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974582050c00/0x8109266df35cb084 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb08b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607533.669707:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974582050c00/0x8109266df35cb084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb08b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782607533.669717:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1782607533.669720:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff974544151000 from 5 10000000:01000000:1.0:1782607533.669723:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782607533.669922:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9745821d0000/0x8109266df35cb092 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607533.669932:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff9745821d0000/0x8109266df35cb092 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607533.669941:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff9745821d0000/0x8109266df35cb092 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607533.669959:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745508ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364346624:0@lo:101: 00000100:00100000:1.0:1782607533.670002:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607533.670030:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff974580d8a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782607533.670111:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364346624 00000100:00100000:3.0:1782607533.670117:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364346624 00000100:00100000:3.0:1782607533.670151:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1782607533.670160:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+16:5800:x1869199364346624:12345-0@lo:101: 00010000:00010000:3.0:1782607533.670171:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607533.670185:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974582051000/0x8109266df35cb099 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cb092 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607533.670205:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974582051000/0x8109266df35cb099 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cb092 expref: 17 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607533.670215:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974582051000/0x8109266df35cb099 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cb092 expref: 17 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607533.670236:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974582051000, rc 0) 00000100:00100000:3.0:1782607533.670287:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+17:5800:x1869199364346624:12345-0@lo:101: Request processed in 128us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607533.670293:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1782607533.670371:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745508ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364346624:0@lo:101: 00010000:00010000:2.0:1782607533.670384:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff9745821d0000/0x8109266df35cb092 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb099 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607533.670392:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff9745821d0000/0x8109266df35cb092 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cb099 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607533.670441:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580c07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364346752:0@lo:256: 00000100:00100000:2.0:1782607533.670471:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607533.670492:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff97457f923240 going to sleep for 11 seconds 00000100:00100000:3.0:1782607533.670586:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364346752 00000100:00100000:3.0:1782607533.670590:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364346752 00000100:00100000:3.0:1782607533.670616:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1782607533.670622:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+17:5800:x1869199364346752:12345-0@lo:256: 20000000:01000000:3.0:1782607533.670635:0:5797:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1782607533.670649:0:5797:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1782607533.670652:0:5797:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1782607533.670720:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+17:5800:x1869199364346752:12345-0@lo:256: Request processed in 97us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607533.670727:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1782607533.670969:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580c07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364346752:0@lo:256: 10000000:01000000:2.0:1782607533.671014:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1782607533.671020:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9745821d0000/0x8109266df35cb092 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb099 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607533.671036:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff9745821d0000/0x8109266df35cb092 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb099 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782607533.671044:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1782607533.671047:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1782607533.671049:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1782607533.671065:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9745585ad000/0x8109266df35cb0a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607533.671072:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff9745585ad000/0x8109266df35cb0a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607533.671079:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff9745585ad000/0x8109266df35cb0a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607533.671090:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580c07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364346880:0@lo:101: 00000100:00100000:2.0:1782607533.671112:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607533.671132:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff97457f923240 going to sleep for 11 seconds 00000100:00100000:3.0:1782607533.671189:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364346880 00000100:00100000:3.0:1782607533.671193:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364346880 00000100:00100000:3.0:1782607533.671212:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1782607533.671217:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+17:5800:x1869199364346880:12345-0@lo:101: 00010000:00010000:3.0:1782607533.671224:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607533.671232:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974582050600/0x8109266df35cb0a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cb0a0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607533.671248:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974582050600/0x8109266df35cb0a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cb0a0 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607533.671255:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974582050600/0x8109266df35cb0a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cb0a0 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607533.671283:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974582050600, rc 0) 00000100:00100000:3.0:1782607533.671308:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+18:5800:x1869199364346880:12345-0@lo:101: Request processed in 90us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607533.671314:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1782607533.671449:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580c07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364346880:0@lo:101: 00010000:00010000:2.0:1782607533.671458:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff9745585ad000/0x8109266df35cb0a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb0a7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607533.671466:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff9745585ad000/0x8109266df35cb0a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cb0a7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607533.671503:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580c07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364347008:0@lo:501: 00000100:00100000:2.0:1782607533.671523:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607533.671547:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff97457f923240 going to sleep for 11 seconds 00000100:00100000:3.0:1782607533.672015:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364347008 00000100:00100000:3.0:1782607533.672021:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364347008 00000100:00100000:3.0:1782607533.672998:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1782607533.673011:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+18:5800:x1869199364347008:12345-0@lo:501: 00000100:00100000:3.0:1782607533.673299:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+18:5800:x1869199364347008:12345-0@lo:501: Request processed in 291us (1773us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607533.673306:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1782607533.673385:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580c07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364347008:0@lo:501: 00000100:00100000:2.0:1782607533.673423:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580c07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364347136:0@lo:503: 00000100:00100000:2.0:1782607533.673459:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607533.678195:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff97457f923240 going to sleep for 11 seconds 00000100:00100000:1.0:1782607533.682018:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364347136 00000100:00100000:1.0:1782607533.682033:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364347136 00000100:00100000:1.0:1782607533.682093:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1782607533.682105:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+18:5800:x1869199364347136:12345-0@lo:503: 00000100:00100000:1.0:1782607533.683520:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+18:5800:x1869199364347136:12345-0@lo:503: Request processed in 1410us (10052us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607533.683534:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1782607533.684733:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580c07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364347136:0@lo:503: 00000100:00100000:3.0:1782607533.688232:0:7889:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580e50000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:7889:1869199364347264:0@lo:502: 00000100:00100000:3.0:1782607533.688536:0:7889:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607533.688585:0:7889:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745442e2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782607533.688679:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364347264 00000100:00100000:2.0:1782607533.688686:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364347264 00000100:00100000:2.0:1782607533.688727:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1782607533.688734:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+18:7889:x1869199364347264:12345-0@lo:502: 00000100:00100000:2.0:1782607533.689197:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+18:7889:x1869199364347264:12345-0@lo:502: Request processed in 461us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607533.689206:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1782607533.689237:0:7889:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580e50000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:7889:1869199364347264:0@lo:502: 00000020:01000000:3.0:1782607533.689568:0:7889:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1782607533.689575:0:7889:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1782607533.689582:0:7889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782607533.689584:0:7889:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1782607533.689589:0:7889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1782607533.689592:0:7889:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.104@tcp to nid 0x20000c0a8ca68 (192.168.202.104@tcp) 00000020:01000000:3.0:1782607533.689612:0:7889:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1782607533.689614:0:7889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782607533.689626:0:7889:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff974577573380) 00000020:00000080:3.0:1782607533.689646:0:7889:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1782607533.689651:0:7889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1782607533.689732:0:7889:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1782607533.689738:0:7889:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:3.0:1782607533.689745:0:7889:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8109266df35cb0b5 00010000:00080000:3.0:1782607533.689792:0:7889:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97457fa05000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.104@tcp at head 00010000:00010000:3.0:1782607533.690022:0:7889:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1782607533.694995:0:7889:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1782607533.695028:0:7889:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1782607533.696114:0:7889:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782607533.696632:0:7889:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782607533.696682:0:7889:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1782607533.696737:0:7889:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1782607533.699532:0:7891:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782607533.699540:0:7891:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1782607533.700245:0:7889:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1782607533.700257:0:7889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1782607533.700307:0:7889:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1782607533.700331:0:7889:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8109266df35cb0bc 00000100:00080000:0.0:1782607533.700505:0:7889:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782607533.700511:0:7889:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97457fa05000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1782607533.700543:0:7889:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97458153b100 x1869199364347392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782607533.700562:0:7889:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1782607533.700593:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97458153b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1869199364347392:0@lo:8: 00000020:01000000:0.0:1782607533.700623:0:7889:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782607533.700628:0:7889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782607533.700630:0:7889:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1782607533.700633:0:7889:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782607533.700648:0:7889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782607533.700649:0:7889:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782607533.700653:0:7889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782607533.700655:0:7889:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1782607533.700680:0:7889:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581538000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:7889:1869199364347520:0@lo:502: 00000100:00100000:2.0:1782607533.701083:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580c07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1869199364347648:0@lo:400: 00000100:00100000:0.0:1782607533.701170:0:7889:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607533.701173:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607533.701202:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580c04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1869199364347776:0@lo:400: 00000100:00100000:1.0:1782607533.701224:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364347392 00000100:00100000:0.0:1782607533.701227:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607533.701230:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364347392 00000100:00100000:0.0:1782607533.701246:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782607533.701252:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580c05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364347904:0@lo:400: 00000100:00100000:0.0:1782607533.701287:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607533.701312:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364347904 00000100:00100000:0.0:1782607533.701316:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364347904 00000100:00100000:0.0:1782607533.701377:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782607533.701387:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581539c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364347904:12345-0@lo:400: 00000100:00100000:0.0:1782607533.701441:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581539c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364347904:12345-0@lo:400: Request processed in 56us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607533.701449:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1782607533.701487:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974580c05880 x1869199364347904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782607533.701500:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580c05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364347904:0@lo:400: 00000100:00100000:0.0:1782607533.701521:0:7889:0:(client.c:2701:ptlrpc_set_wait()) set ffff97456a83fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1782607533.701544:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782607533.701549:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3315:x1869199364347392:12345-0@lo:8: 00010000:00080000:1.0:1782607533.701572:0:6608:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:1.0:1782607533.701603:0:6608:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8109266df35cb0c3 00002000:00100000:1.0:1782607533.701617:0:6608:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff974580e4c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113669 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1782607533.701622:0:6608:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1782607533.701626:0:6608:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1782607533.701707:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364347520 00000100:00100000:3.0:1782607533.701711:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364347520 00000100:00100000:3.0:1782607533.701753:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1782607533.701760:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+18:7889:x1869199364347520:12345-0@lo:502: 00002000:00100000:1.0:1782607533.701760:0:6608:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1782607533.701936:0:6608:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1782607533.701960:0:6608:0:(import.c:65:import_set_state_nolock()) ffff974580e4e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782607533.702057:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1869199364347392:12345-0@lo:8: Request processed in 505us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607533.702064:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1782607533.702186:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97458153b100 x1869199364347392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782607543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782607533.702195:0:3315:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782607533.702202:0:3315:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1782607533.702208:0:3315:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1782607533.702218:0:3315:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1782607533.702221:0:3315:0:(import.c:65:import_set_state_nolock()) ffff97457fa05000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1782607533.702233:0:3315:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1782607533.702239:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97458153b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1869199364347392:0@lo:8: 00000100:00100000:3.0:1782607533.702246:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+18:7889:x1869199364347520:12345-0@lo:502: Request processed in 487us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607533.702253:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000004:00080000:3.0:1782607533.702301:0:7891:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1782607533.702390:0:7891:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 192548623926ns, next at 0ns, rc = 0 00000100:00100000:1.0:1782607533.702468:0:7889:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581538000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:7889:1869199364347520:0@lo:502: 00000020:01000000:1.0:1782607533.702498:0:7889:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782607533.702504:0:7889:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782607533.702506:0:7889:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1782607533.702511:0:7889:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:2.0:1782607533.703939:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607533.704178:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782607533.704190:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580c06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1869199364348032:0@lo:400: 00000100:00100000:2.0:1782607533.704239:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607533.704292:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364347776 00000100:00100000:2.0:1782607533.704299:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364347776 00000100:00100000:2.0:1782607533.704339:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364347648 00000100:00100000:2.0:1782607533.704342:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364347648 00000100:00100000:2.0:1782607533.704357:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364348032 00000100:00100000:2.0:1782607533.704360:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364348032 00000100:00100000:2.0:1782607533.704376:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782607533.704383:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458153bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869199364347776:12345-0@lo:400: 00000100:00100000:2.0:1782607533.704432:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458153bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869199364347776:12345-0@lo:400: Request processed in 49us (3203us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607533.704446:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782607533.704461:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782607533.704467:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580c05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1869199364347648:12345-0@lo:400: 00000100:00100000:2.0:1782607533.704500:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580c05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1869199364347648:12345-0@lo:400: Request processed in 33us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607533.704506:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782607533.704516:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782607533.704522:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580c07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1869199364348032:12345-0@lo:400: 00000100:00100000:2.0:1782607533.704548:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580c07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1869199364348032:12345-0@lo:400: Request processed in 26us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607533.704552:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1782607533.704567:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782607533.704572:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782607533.704597:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974580c06a00 x1869199364348032/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782607549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782607533.704610:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580c06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1869199364348032:0@lo:400: 00010000:00080000:2.0:1782607533.704621:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974580c07100 x1869199364347648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782607549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782607533.704630:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580c07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1869199364347648:0@lo:400: 00000020:01000000:2.0:1782607533.704653:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1782607533.704675:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1782607533.704684:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9745585ad000/0x8109266df35cb0a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb0a7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607533.704694:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff9745585ad000/0x8109266df35cb0a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb0a7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782607533.704709:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1782607533.704711:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff974549e68000 from 1 10000000:01000000:2.0:1782607533.704714:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1782607533.704757:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9745585ac400/0x8109266df35cb0ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1782607533.705760:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974580c04380 x1869199364347776/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782607549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782607533.705875:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580c04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1869199364347776:0@lo:400: 00010000:00010000:2.0:1782607533.706328:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff9745585ac400/0x8109266df35cb0ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607533.706344:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff9745585ac400/0x8109266df35cb0ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607533.707236:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580c07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364348160:0@lo:101: 00000100:00100000:2.0:1782607533.707312:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607533.707447:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364348160 00000100:00100000:3.0:1782607533.707454:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364348160 00000100:00100000:3.0:1782607533.707502:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1782607533.707512:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+18:5800:x1869199364348160:12345-0@lo:101: 00010000:00010000:3.0:1782607533.707526:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607533.707542:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974582050a00/0x8109266df35cb0d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cb0ca expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607533.707562:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff97457f9239c0 going to sleep for 11 seconds 00010000:00010000:3.0:1782607533.707575:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974582050a00/0x8109266df35cb0d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cb0ca expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607533.707585:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974582050a00/0x8109266df35cb0d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cb0ca expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607533.707594:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974582050a00, rc 0) 00000100:00100000:3.0:1782607533.707629:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+19:5800:x1869199364348160:12345-0@lo:101: Request processed in 118us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607533.707635:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1782607533.707642:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580c07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364348160:0@lo:101: 00010000:00010000:2.0:1782607533.707654:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff9745585ac400/0x8109266df35cb0ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb0d1 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607533.707663:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff9745585ac400/0x8109266df35cb0ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cb0d1 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607533.707719:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580c07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364348288:0@lo:501: 00000100:00100000:2.0:1782607533.707749:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607533.707793:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff97457f9239c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782607533.707913:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364348288 00000100:00100000:1.0:1782607533.707918:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364348288 00000100:00100000:1.0:1782607533.707943:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1782607533.707950:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+19:5800:x1869199364348288:12345-0@lo:501: 00000100:00100000:1.0:1782607533.708135:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+19:5800:x1869199364348288:12345-0@lo:501: Request processed in 185us (386us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782607533.708143:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1782607533.708176:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580c07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364348288:0@lo:501: 10000000:01000000:1.0:1782607533.708199:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1782607533.708206:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9745585ac400/0x8109266df35cb0ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb0d1 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607533.708215:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff9745585ac400/0x8109266df35cb0ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb0d1 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782607533.744384:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1782607533.819947:0:7892:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1782607533.819976:0:7892:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580c06300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7892:1869199364348544:0@lo:7: 00000100:00100000:2.0:1782607533.820052:0:7892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607533.820093:0:7892:0:(client.c:2701:ptlrpc_set_wait()) set ffff97457f923540 going to sleep for 11 seconds 00000100:00100000:2.0:1782607533.820107:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782607533.820119:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580c06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364348416:0@lo:13: 00000100:00100000:2.0:1782607533.820144:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607533.820206:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364348544 00000100:00100000:0.0:1782607533.820214:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364348544 00000100:00100000:0.0:1782607533.820289:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782607533.820299:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580c05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7892:x1869199364348544:12345-0@lo:7: 00000100:00080000:1.0:1782607533.831138:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782607533.831169:0:6613:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364348416 00000100:00100000:1.0:1782607533.831180:0:6613:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364348416 00000100:00100000:1.0:1782607533.831520:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782607533.831534:0:6613:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580c05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1869199364348416:12345-0@lo:13: 00002000:00000024:1.0:1782607533.831578:0:6613:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1782607533.831665:0:6613:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580c05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1869199364348416:12345-0@lo:13: Request processed in 134us (11519us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607533.831679:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1782607533.831729:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974580c06a00 x1869199364348416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607549 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607533.831752:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580c06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364348416:0@lo:13: 00002000:00080000:0.0:1782607533.856711:0:6609:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1782607533.856721:0:6609:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1782607533.856837:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580c05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7892:x1869199364348544:12345-0@lo:7: Request processed in 36536us (36781us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607533.856848:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1782607533.856924:0:7892:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974580c06300 x1869199364348544/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782607549 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782607533.856939:0:7892:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580c06300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7892:1869199364348544:0@lo:7: 00000004:00080000:0.0:1782607533.856952:0:7892:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1782607533.856990:0:7892:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97458153b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7892:1869199364348672:0@lo:5: 00000100:00100000:0.0:1782607533.857023:0:7892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607533.857060:0:7892:0:(client.c:2701:ptlrpc_set_wait()) set ffff97456a83f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782607533.857076:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364348672 00000100:00100000:0.0:1782607533.857082:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364348672 00000100:00100000:0.0:1782607533.857118:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782607533.857126:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458153ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7892:x1869199364348672:12345-0@lo:5: 00002000:00080000:0.0:1782607533.857162:0:6608:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1782607533.857166:0:6608:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1782607533.860006:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458153ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7892:x1869199364348672:12345-0@lo:5: Request processed in 2871us (2973us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1782607533.860019:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1782607533.860503:0:7892:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97458153b100 x1869199364348672/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782607549 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607533.860521:0:7892:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97458153b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7892:1869199364348672:0@lo:5: 00000004:00080000:3.0:1782607533.860536:0:7892:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1782607533.860576:0:7892:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580e50000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7892:1869199364348800:0@lo:700: 00000100:00100000:3.0:1782607533.860612:0:7892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607533.860645:0:7892:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745442e2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782607533.861853:0:6617:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364348800 00000100:00100000:0.0:1782607533.861863:0:6617:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364348800 00000100:00100000:0.0:1782607533.861923:0:6617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782607533.861935:0:6617:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580e51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7892:x1869199364348800:12345-0@lo:700: 00000100:00100000:0.0:1782607533.861992:0:6617:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97458153b800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6617:1869199364348928:0@lo:700: 00000100:00100000:0.0:1782607533.862041:0:6617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607533.862071:0:6617:0:(client.c:2701:ptlrpc_set_wait()) set ffff97456a83fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1782607533.862301:0:5810:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364348928 00000100:00100000:3.0:1782607533.862306:0:5810:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364348928 00000100:00100000:3.0:1782607533.862344:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782607533.862352:0:5810:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581538000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6617:x1869199364348928:12345-0@lo:700: 40000000:02000000:2.0:1782607533.961579:0:5810:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1782607533.969611:0:5810:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581538000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6617:x1869199364348928:12345-0@lo:700: Request processed in 107249us (107558us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607533.969629:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1782607533.970028:0:6617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97458153b800 x1869199364348928/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1782607549 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607533.970045:0:6617:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97458153b800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6617:1869199364348928:0@lo:700: 40000000:02000000:1.0:1782607533.970058:0:6617:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:0.0:1782607534.073513:0:6617:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580e51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7892:x1869199364348800:12345-0@lo:700: Request processed in 211570us (212888us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607534.073527:0:6617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00080000:2.0:1782607534.073646:0:7525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1782607534.073659:0:7525:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:3.0:1782607534.073725:0:7892:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974580e50000 x1869199364348800/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1782607549 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607534.073742:0:7892:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580e50000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7892:1869199364348800:0@lo:700: 00000004:02000040:3.0:1782607534.128502:0:7892:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1782607534.133686:0:7892:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580e50000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7892:1869199364349056:0@lo:5: 00000100:00100000:3.0:1782607534.133791:0:7892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607534.133844:0:7892:0:(client.c:2701:ptlrpc_set_wait()) set ffff974580d8ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1782607534.134082:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364349056 00000100:00100000:1.0:1782607534.134091:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364349056 00000100:00100000:1.0:1782607534.134140:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782607534.134150:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580e52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7892:x1869199364349056:12345-0@lo:5: 00002000:00080000:1.0:1782607534.155603:0:6609:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1782607534.155627:0:6609:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1782607534.178489:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580e52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7892:x1869199364349056:12345-0@lo:5: Request processed in 44332us (44717us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1782607534.178506:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1782607534.178662:0:7892:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974580e50000 x1869199364349056/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782607550 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782607534.178678:0:7892:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1782607534.178693:0:7892:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff974580e50000 x1869199364349056/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782607550 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782607534.178704:0:7892:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580e50000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7892:1869199364349056:0@lo:5: 00000004:00080000:2.0:1782607534.178720:0:7892:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1782607534.277590:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782607535.170455:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782607535.170483:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97458153b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364349184:0@lo:13: 00000100:00100000:2.0:1782607535.170558:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607535.170736:0:6613:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364349184 00000100:00100000:0.0:1782607535.170745:0:6613:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364349184 00000100:00100000:0.0:1782607535.170939:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782607535.170951:0:6613:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580c06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364349184:12345-0@lo:13: 00002000:00000024:0.0:1782607535.170988:0:6613:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782607535.171034:0:6613:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580c06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364349184:12345-0@lo:13: Request processed in 85us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607535.171041:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1782607535.171194:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97458153b100 x1869199364349184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607551 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782607535.171213:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97458153b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364349184:0@lo:13: 00000100:00080000:1.0:1782607535.173521:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782607535.298071:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607536.344045:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607537.356604:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607538.372309:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782607538.434689:0:7525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:3.0:1782607538.754634:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580e52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364349696:0@lo:400: 00000100:00100000:3.0:1782607538.754712:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607538.754798:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782607538.754805:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580e51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fae11c6e-4506-4104-bb8c-df42498f7e08:3316:1869199364349312:0@lo:400: 00000100:00100000:3.0:1782607538.754837:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607538.754861:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580e51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1869199364349824:0@lo:400: 00000100:00100000:3.0:1782607538.754888:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607538.754913:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580e52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1869199364349440:0@lo:400: 00000100:00100000:3.0:1782607538.754935:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607538.755328:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580e51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364349952:0@lo:400: 00000100:00100000:3.0:1782607538.755368:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607538.755516:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364349824 00000100:00100000:1.0:1782607538.755525:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364349824 00000100:00080000:2.0:1782607538.755578:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782607538.755613:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364349440 00000100:00100000:1.0:1782607538.755617:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364349440 00000100:00100000:1.0:1782607538.755647:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782607538.755656:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580e51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869199364349824:12345-0@lo:400: 00000100:00100000:2.0:1782607538.755706:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782607538.755726:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580e51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869199364349824:12345-0@lo:400: Request processed in 72us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607538.755727:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580e52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1869199364349440:12345-0@lo:400: 00000100:00100000:1.0:1782607538.755749:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782607538.755901:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782607538.755912:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580e53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1869199364349568:0@lo:400: 00000100:00100000:3.0:1782607538.756019:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607538.756207:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364349568 00000100:00100000:1.0:1782607538.756212:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364349568 00000100:00100000:1.0:1782607538.756254:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782607538.756261:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580e50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1869199364349568:12345-0@lo:400: 00000100:00100000:1.0:1782607538.756295:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580e50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1869199364349568:12345-0@lo:400: Request processed in 33us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607538.756301:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1782607538.756314:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782607538.756741:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364349696 00000100:00100000:0.0:1782607538.756746:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364349696 00000100:00100000:0.0:1782607538.756852:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364349952 00000100:00100000:0.0:1782607538.756856:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364349952 00000100:00080000:1.0:1782607538.757032:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782607538.757036:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782607538.757132:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782607538.757139:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364349696:12345-0@lo:400: 00000100:00100000:0.0:1782607538.757185:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364349696:12345-0@lo:400: Request processed in 47us (2474us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607538.757192:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782607538.757204:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782607538.757211:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364349952:12345-0@lo:400: 00000100:00100000:0.0:1782607538.757249:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364349952:12345-0@lo:400: Request processed in 39us (1887us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607538.757255:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782607538.759470:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580e52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1869199364349440:12345-0@lo:400: Request processed in 3731us (4521us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607538.759497:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1782607538.761098:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974580e52a00 x1869199364349440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782607554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607538.761127:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580e52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1869199364349440:0@lo:400: 00000100:00100000:3.0:1782607538.761157:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364349312 00000100:00100000:3.0:1782607538.761164:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364349312 00000100:00100000:3.0:1782607538.761212:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1782607538.761244:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3316:x1869199364349312:12345-0@lo:400: 00000100:00100000:3.0:1782607538.761331:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3316:x1869199364349312:12345-0@lo:400: Request processed in 89us (6493us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607538.761339:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1782607538.761576:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580e51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fae11c6e-4506-4104-bb8c-df42498f7e08:3316:1869199364349312:0@lo:400: 00010000:00080000:3.0:1782607538.761595:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974580e51c00 x1869199364349824/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782607554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607538.761605:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580e51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1869199364349824:0@lo:400: 00010000:00080000:3.0:1782607538.761619:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974580e52300 x1869199364349696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607538.761627:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580e52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364349696:0@lo:400: 00010000:00080000:3.0:1782607538.761668:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974580e51f80 x1869199364349952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607538.761676:0:3318:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1782607538.761686:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580e51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364349952:0@lo:400: 00010000:00080000:3.0:1782607538.761704:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974580e53100 x1869199364349568/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782607554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607538.761712:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580e53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1869199364349568:0@lo:400: 00000100:00100000:0.0:1782607539.300724:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580e53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364350080:0@lo:13: 00000100:00100000:0.0:1782607539.300819:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607539.301646:0:6613:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364350080 00000100:00100000:2.0:1782607539.301657:0:6613:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364350080 00000100:00100000:2.0:1782607539.301726:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782607539.301736:0:6613:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458153b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364350080:12345-0@lo:13: 00002000:00000024:2.0:1782607539.301790:0:6613:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:0.0:1782607539.329107:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974580e53100 x1869199364350080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607555 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782607539.329137:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580e53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364350080:0@lo:13: 00000100:00100000:2.0:1782607539.336628:0:6613:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458153b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364350080:12345-0@lo:13: Request processed in 34884us (35799us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607539.336643:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1782607539.394071:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782607540.011812:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607540.011915:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342305664 00000100:00100000:1.0:1782607540.011925:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342305664 00000100:00100000:1.0:1782607540.011974:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 112 00000100:00100000:1.0:1782607540.011982:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2353:x1869199342305664:12345-192.168.202.4@tcp:250: 00010000:00080000:1.0:1782607540.012012:0:5797:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 0f69b9a4-d9fb-49e3-b427-4394300cdc40@192.168.202.4@tcp t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:1.0:1782607540.012042:0:5797:0:(genops.c:1406:class_connect()) connect: client 0f69b9a4-d9fb-49e3-b427-4394300cdc40, cookie 0x8109266df35cb0d8 00000100:00080000:1.0:1782607540.012212:0:5797:0:(import.c:65:import_set_state_nolock()) ffff974580e4a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782607540.012285:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+5:2353:x1869199342305664:12345-192.168.202.4@tcp:250: Request processed in 301us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607540.012293:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 112 00000100:00100000:2.0:1782607540.020911:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607540.021214:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342305536 00000100:00100000:1.0:1782607540.021235:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342305536 00000100:00100000:1.0:1782607540.021314:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 113 00000100:00100000:1.0:1782607540.021325:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+5:5557:x1869199342305536:12345-192.168.202.4@tcp:101: 00010000:00010000:1.0:1782607540.021343:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607540.021390:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9745821d1600/0x8109266df35cb0df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffb83 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607540.021420:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9745821d1600/0x8109266df35cb0df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffb83 expref: 6 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607540.021433:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9745821d1600/0x8109266df35cb0df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffb83 expref: 6 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607540.021443:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745821d1600, rc 0) 00000100:00100000:1.0:1782607540.021503:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+6:5557:x1869199342305536:12345-192.168.202.4@tcp:101: Request processed in 180us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607540.021510:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 113 00000100:00100000:0.0:1782607540.024602:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607540.024718:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342305792 00000100:00100000:3.0:1782607540.024735:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342305792 00000100:00100000:3.0:1782607540.024847:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 114 00000100:00100000:3.0:1782607540.024859:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+6:5557:x1869199342305792:12345-192.168.202.4@tcp:501: 00000100:00100000:3.0:1782607540.026229:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+6:5557:x1869199342305792:12345-192.168.202.4@tcp:501: Request processed in 1355us (1620us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782607540.026243:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 114 00000100:00100000:2.0:1782607540.031061:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607540.031361:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342305920 00000100:00100000:3.0:1782607540.031374:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342305920 00000100:00100000:3.0:1782607540.031505:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 115 00000100:00100000:3.0:1782607540.031520:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+6:5557:x1869199342305920:12345-192.168.202.4@tcp:101: 00010000:00010000:3.0:1782607540.031547:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607540.031570:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974582050400/0x8109266df35cb0e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffb8a expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607540.031609:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974582050400/0x8109266df35cb0e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffb8a expref: 7 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607540.031623:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974582050400/0x8109266df35cb0e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffb8a expref: 7 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607540.031634:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974582050400, rc 0) 00000100:00100000:3.0:1782607540.031732:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+7:5557:x1869199342305920:12345-192.168.202.4@tcp:101: Request processed in 216us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607540.031740:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 115 00000100:00100000:2.0:1782607540.035470:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607540.035623:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342306048 00000100:00100000:3.0:1782607540.035636:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342306048 00000100:00100000:3.0:1782607540.035747:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 116 00000100:00100000:3.0:1782607540.035760:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+7:5557:x1869199342306048:12345-192.168.202.4@tcp:501: 00000100:00100000:3.0:1782607540.036620:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+8:5557:x1869199342306048:12345-192.168.202.4@tcp:501: Request processed in 859us (1160us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607540.036645:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 116 00000100:00100000:0.0:1782607540.039897:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607540.040079:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342306176 00000100:00100000:3.0:1782607540.040093:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342306176 00000100:00100000:3.0:1782607540.040349:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 117 00000100:00100000:3.0:1782607540.040364:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+8:5557:x1869199342306176:12345-192.168.202.4@tcp:503: 00000100:00100000:3.0:1782607540.041429:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+8:5557:x1869199342306176:12345-192.168.202.4@tcp:503: Request processed in 1061us (1538us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607540.041442:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 117 00000100:00100000:2.0:1782607540.047477:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607540.047604:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342306304 00000100:00100000:3.0:1782607540.047617:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342306304 00000100:00100000:2.0:1782607540.047834:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 118 00000100:00100000:2.0:1782607540.047848:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+8:5575:x1869199342306304:12345-192.168.202.4@tcp:502: 00000100:00100000:2.0:1782607540.049431:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+8:5575:x1869199342306304:12345-192.168.202.4@tcp:502: Request processed in 1573us (1955us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607540.049447:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 118 00000100:00100000:2.0:1782607540.095398:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607540.095817:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342306432 00000100:00100000:3.0:1782607540.095832:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342306432 00000100:00100000:3.0:1782607540.095926:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 119 00000100:00100000:3.0:1782607540.095939:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+8:5575:x1869199342306432:12345-192.168.202.4@tcp:502: 00000100:00100000:2.0:1782607540.108568:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+8:5575:x1869199342306432:12345-192.168.202.4@tcp:502: Request processed in 12612us (13164us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607540.108588:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 119 00000100:00100000:0.0:1782607540.122280:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607540.123070:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342306560 00000100:00100000:2.0:1782607540.123087:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342306560 00000100:00100000:2.0:1782607540.123300:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 120 00000100:00100000:2.0:1782607540.123312:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+8:5557:x1869199342306560:12345-192.168.202.4@tcp:101: 00010000:00010000:2.0:1782607540.123358:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607540.123383:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9745585aca00/0x8109266df35cb0ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffbb4 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607540.123421:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9745585aca00/0x8109266df35cb0ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffbb4 expref: 9 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607540.123434:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9745585aca00/0x8109266df35cb0ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffbb4 expref: 9 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607540.123445:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585aca00, rc 0) 00000100:00100000:2.0:1782607540.123530:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+9:5557:x1869199342306560:12345-192.168.202.4@tcp:101: Request processed in 220us (1266us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607540.123538:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 120 00000100:00100000:0.0:1782607540.127473:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607540.128840:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342306688 00000100:00100000:1.0:1782607540.128857:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342306688 00000100:00100000:1.0:1782607540.128991:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 121 00000100:00100000:1.0:1782607540.129005:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+9:5557:x1869199342306688:12345-192.168.202.4@tcp:256: 20000000:01000000:1.0:1782607540.129043:0:5795:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1782607540.129076:0:5795:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1782607540.129080:0:5795:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1782607540.129084:0:5795:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1782607540.129086:0:5795:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1782607540.134285:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+9:5557:x1869199342306688:12345-192.168.202.4@tcp:256: Request processed in 5265us (6814us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607540.134303:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 121 00000100:00100000:0.0:1782607540.141258:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607540.141461:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342306816 00000100:00100000:2.0:1782607540.141475:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342306816 00000100:00100000:2.0:1782607540.141548:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 122 00000100:00100000:2.0:1782607540.141560:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+9:5557:x1869199342306816:12345-192.168.202.4@tcp:101: 00010000:00010000:2.0:1782607540.141585:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607540.141609:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9745585ad600/0x8109266df35cb0f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffbbb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607540.141645:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9745585ad600/0x8109266df35cb0f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffbbb expref: 10 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607540.141681:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9745585ad600/0x8109266df35cb0f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffbbb expref: 10 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607540.141892:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585ad600, rc 0) 00000100:00100000:2.0:1782607540.142087:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+10:5557:x1869199342306816:12345-192.168.202.4@tcp:101: Request processed in 520us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607540.142163:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 122 00000100:00100000:0.0:1782607540.149404:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607540.149565:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342306944 00000100:00100000:3.0:1782607540.149579:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342306944 00000100:00100000:3.0:1782607540.149657:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 123 00000100:00100000:3.0:1782607540.149669:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+10:5557:x1869199342306944:12345-192.168.202.4@tcp:501: 00000100:00100000:3.0:1782607540.150146:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+10:5557:x1869199342306944:12345-192.168.202.4@tcp:501: Request processed in 477us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607540.150156:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 123 00000100:00100000:0.0:1782607540.153465:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607540.153666:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342307072 00000100:00100000:2.0:1782607540.153679:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342307072 00000100:00100000:2.0:1782607540.153760:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 124 00000100:00100000:2.0:1782607540.153813:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+10:5557:x1869199342307072:12345-192.168.202.4@tcp:503: 00000100:00100000:2.0:1782607540.154583:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+10:5557:x1869199342307072:12345-192.168.202.4@tcp:503: Request processed in 771us (1131us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607540.154595:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 124 00000100:00100000:0.0:1782607540.160882:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607540.161737:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342307200 00000100:00100000:2.0:1782607540.161752:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342307200 00000100:00100000:2.0:1782607540.161855:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 125 00000100:00100000:2.0:1782607540.161867:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974548ac5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+10:5580:x1869199342307200:12345-192.168.202.4@tcp:502: 00000100:00100000:2.0:1782607540.162269:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974548ac5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+10:5580:x1869199342307200:12345-192.168.202.4@tcp:502: Request processed in 403us (1400us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607540.162278:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 125 00000100:00100000:0.0:1782607540.167715:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607540.167901:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342307328 00000100:00100000:3.0:1782607540.167916:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342307328 00000100:00100000:3.0:1782607540.167990:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 126 00000100:00100000:3.0:1782607540.168003:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974548ac5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+10:5580:x1869199342307328:12345-192.168.202.4@tcp:502: 00000100:00100000:3.0:1782607540.168405:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974548ac5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+10:5580:x1869199342307328:12345-192.168.202.4@tcp:502: Request processed in 403us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607540.168415:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 126 00000100:00100000:0.0:1782607540.173595:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607540.173750:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342307456 00000100:00100000:1.0:1782607540.173806:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342307456 00000100:00100000:1.0:1782607540.173862:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4 00000100:00100000:1.0:1782607540.173871:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458153b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2353:x1869199342307456:12345-192.168.202.4@tcp:38: 00010000:00080000:1.0:1782607540.173930:0:5805:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from d72d7fb9-639f-4ad9-b658-df715cbf7792@192.168.202.4@tcp t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:1.0:1782607540.173995:0:5805:0:(genops.c:1406:class_connect()) connect: client d72d7fb9-639f-4ad9-b658-df715cbf7792, cookie 0x8109266df35cb0fb 00000004:00100000:1.0:1782607540.174039:0:5805:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1782607540.174047:0:5805:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1782607540.217323:0:5805:0:(import.c:65:import_set_state_nolock()) ffff974580e4c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782607540.217455:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458153b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2353:x1869199342307456:12345-192.168.202.4@tcp:38: Request processed in 43581us (43873us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607540.217470:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4 00000100:00100000:3.0:1782607540.290201:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580c06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364350208:0@lo:13: 00000100:00100000:3.0:1782607540.290323:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607540.290478:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364350208 00000100:00100000:2.0:1782607540.290491:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364350208 00000100:00100000:2.0:1782607540.290583:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782607540.290596:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364350208:12345-0@lo:13: 00002000:00000024:2.0:1782607540.290668:0:6612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782607540.290825:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364350208:12345-0@lo:13: Request processed in 231us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607540.290835:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1782607540.290887:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974580c06a00 x1869199364350208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607556 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782607540.290912:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580c06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364350208:0@lo:13: 00000100:00080000:3.0:1782607540.291055:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782607540.418116:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782607541.226421:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607541.226546:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342307584 00000100:00100000:2.0:1782607541.226560:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342307584 00000100:00100000:2.0:1782607541.226656:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5 00000100:00100000:2.0:1782607541.226670:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745509ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:0:x1869199342307584:12345-192.168.202.4@tcp:41: 00000100:00080000:1.0:1782607541.226697:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:2.0:1782607541.226741:0:5804:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1782607541.226872:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745509ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:0:x1869199342307584:12345-192.168.202.4@tcp:41: Request processed in 204us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607541.226881:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5 00000100:00100000:0.0:1782607541.229390:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607541.229515:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342307712 00000100:00100000:2.0:1782607541.229526:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342307712 00000100:00100000:2.0:1782607541.229598:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 6 00000100:00100000:2.0:1782607541.229609:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745509eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:5557:x1869199342307712:12345-192.168.202.4@tcp:41: 00000004:00000024:2.0:1782607541.229651:0:7437:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1782607541.229748:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745509eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:5557:x1869199342307712:12345-192.168.202.4@tcp:41: Request processed in 140us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607541.229756:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 6 00000100:00100000:1.0:1782607541.240892:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607541.241044:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342307840 00000100:00100000:2.0:1782607541.241060:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342307840 00000100:00100000:2.0:1782607541.241514:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7 00000100:00100000:2.0:1782607541.241553:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:5557:x1869199342307840:12345-192.168.202.4@tcp:40: 00000100:00100000:2.0:1782607541.241894:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:5557:x1869199342307840:12345-192.168.202.4@tcp:40: Request processed in 344us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607541.241903:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7 00000100:00100000:3.0:1782607541.244416:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607541.244531:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607541.244793:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342307968 00000100:00100000:0.0:1782607541.244805:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342307968 00000100:00100000:0.0:1782607541.244924:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8 00000100:00100000:0.0:1782607541.244936:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1869199342307968:12345-192.168.202.4@tcp:8: 00010000:00080000:0.0:1782607541.244979:0:6610:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from d72d7fb9-639f-4ad9-b658-df715cbf7792@192.168.202.4@tcp t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:0.0:1782607541.245022:0:6610:0:(genops.c:1406:class_connect()) connect: client d72d7fb9-639f-4ad9-b658-df715cbf7792, cookie 0x8109266df35cb102 00002000:00100000:0.0:1782607541.245039:0:6610:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d72d7fb9-639f-4ad9-b658-df715cbf7792/ffff97457fb87800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782607541.245055:0:6610:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1782607541.245999:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342308096 00000100:00100000:1.0:1782607541.246009:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342308096 00000100:00100000:1.0:1782607541.246071:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 127 00000100:00100000:1.0:1782607541.246081:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974548ac7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+10:2355:x1869199342308096:12345-192.168.202.4@tcp:400: 00000100:00100000:1.0:1782607541.246213:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974548ac7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+10:2355:x1869199342308096:12345-192.168.202.4@tcp:400: Request processed in 126us (1672us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607541.246221:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 127 00002000:00080000:0.0:1782607541.247971:0:6610:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1782607541.248027:0:6610:0:(import.c:65:import_set_state_nolock()) ffff97457fb83000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782607541.249851:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2353:x1869199342307968:12345-192.168.202.4@tcp:8: Request processed in 4903us (5504us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607541.249869:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8 00000100:00100000:2.0:1782607541.252828:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607541.252965:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607541.254018:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342308224 00000100:00100000:0.0:1782607541.254033:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342308224 00000100:00100000:0.0:1782607541.254107:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 9 00000100:00100000:0.0:1782607541.254118:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580c07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1869199342308224:12345-192.168.202.4@tcp:8: 00010000:00080000:0.0:1782607541.254161:0:6609:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from d72d7fb9-639f-4ad9-b658-df715cbf7792@192.168.202.4@tcp t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:0.0:1782607541.254229:0:6609:0:(genops.c:1406:class_connect()) connect: client d72d7fb9-639f-4ad9-b658-df715cbf7792, cookie 0x8109266df35cb109 00002000:00100000:0.0:1782607541.254245:0:6609:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d72d7fb9-639f-4ad9-b658-df715cbf7792/ffff97457fb85800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782607541.254751:0:6609:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1782607541.255390:0:6609:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1782607541.255587:0:6609:0:(import.c:65:import_set_state_nolock()) ffff97457fb86800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782607541.255828:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580c07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2353:x1869199342308224:12345-192.168.202.4@tcp:8: Request processed in 1709us (2860us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607541.255840:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 9 00000100:00100000:3.0:1782607541.256412:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342308352 00000100:00100000:3.0:1782607541.256425:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342308352 00000100:00100000:3.0:1782607541.259638:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 0 00000100:00100000:3.0:1782607541.259670:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580c06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:5557:x1869199342308352:12345-192.168.202.4@tcp:33: 00000004:00080000:3.0:1782607541.293065:0:5806:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 33109us 00000004:00200000:0.0:1782607541.311932:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1782607541.312250:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580c06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:5557:x1869199342308352:12345-192.168.202.4@tcp:33: Request processed in 52588us (59428us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607541.312278:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 0 00010000:00010000:0.0:1782607541.442690:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782607541.518440:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607541.518650:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342308480 00000100:00100000:0.0:1782607541.518664:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342308480 00000100:00100000:0.0:1782607541.518756:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8 00000100:00100000:0.0:1782607541.518818:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580c04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:5598:x1869199342308480:12345-192.168.202.4@tcp:101: 00010000:00010000:0.0:1782607541.518854:0:7437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607541.521505:0:7437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974540030e00/0x8109266df35cb110 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffbe5 expref: -99 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607541.521595:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cb117 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607541.521619:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cb117 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607541.521636:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cb117 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782607541.521891:0:7437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1782607541.521895:0:7437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1782607541.521992:0:7437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cb117 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607541.522040:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974540030e00/0x8109266df35cb110 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffbe5 expref: 8 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607541.522055:0:7437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cb117 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffbe5 expref: 7 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607541.522061:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97454c8e3b00) 00010000:00010000:0.0:1782607541.522063:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782607541.522065:0:7437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974540030600, rc 0) 00000100:00100000:0.0:1782607541.522917:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580c04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:5598:x1869199342308480:12345-192.168.202.4@tcp:101: Request processed in 4143us (4485us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607541.522938:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8 00000001:00100000:2.0:1782607542.426833:0:6634:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d72d7fb9-639f-4ad9-b658-df715cbf7792 00010000:00010000:3.0:1782607542.466422:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607543.489945:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782607543.744350:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607543.744755:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342308608 00000100:00100000:1.0:1782607543.744807:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342308608 00000100:00100000:1.0:1782607543.744899:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 9 00000100:00100000:1.0:1782607543.744912:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580e50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:5650:x1869199342308608:12345-192.168.202.4@tcp:41: 00000004:00000024:1.0:1782607543.744979:0:5803:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1782607543.745082:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580e50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:5650:x1869199342308608:12345-192.168.202.4@tcp:41: Request processed in 171us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607543.745090:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 9 00000100:00080000:3.0:1782607543.747284:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782607543.754529:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607543.754680:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342308736 00000100:00100000:2.0:1782607543.754694:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342308736 00000100:00100000:2.0:1782607543.754823:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 9 00000100:00100000:2.0:1782607543.754835:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:5650:x1869199342308736:12345-192.168.202.4@tcp:13: 00002000:00000024:2.0:1782607543.754895:0:6612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782607543.754982:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:5650:x1869199342308736:12345-192.168.202.4@tcp:13: Request processed in 148us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607543.754991:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 9 00000100:00080000:3.0:1782607543.755538:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782607543.769796:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607543.769952:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342308864 00000100:00100000:2.0:1782607543.769973:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342308864 00000100:00080000:1.0:1782607543.770109:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782607543.770320:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 10 00000100:00100000:2.0:1782607543.770342:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745509ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:5650:x1869199342308864:12345-192.168.202.4@tcp:13: 00002000:00000024:2.0:1782607543.770383:0:6612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782607543.770454:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745509ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:5650:x1869199342308864:12345-192.168.202.4@tcp:13: Request processed in 124us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607543.770462:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 10 00000100:00100000:3.0:1782607543.875384:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782607543.875409:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fae11c6e-4506-4104-bb8c-df42498f7e08:3316:1869199364350336:0@lo:400: 00000100:00100000:3.0:1782607543.875484:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607543.875599:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364350336 00000100:00100000:0.0:1782607543.875607:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364350336 00000100:00100000:0.0:1782607543.875660:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1782607543.875669:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3316:x1869199364350336:12345-0@lo:400: 00000100:00100000:0.0:1782607543.875718:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3316:x1869199364350336:12345-0@lo:400: Request processed in 50us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607543.875725:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1782607543.875885:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1869199364350464:0@lo:400: 00000100:00100000:0.0:1782607543.875923:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607543.875948:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d460e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364350976:0@lo:400: 00000100:00100000:0.0:1782607543.875980:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607543.875998:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782607543.876002:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1869199364350592:0@lo:400: 00000100:00100000:0.0:1782607543.876038:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607543.876356:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364350976 00000100:00100000:0.0:1782607543.876361:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364350976 00000100:00100000:0.0:1782607543.876403:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782607543.876408:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745509ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364350976:12345-0@lo:400: 00000100:00100000:0.0:1782607543.876448:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745509ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364350976:12345-0@lo:400: Request processed in 40us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607543.876455:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782607543.876473:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364350464 00000100:00100000:0.0:1782607543.876477:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364350464 00000100:00100000:0.0:1782607543.876498:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364350592 00000100:00100000:0.0:1782607543.876500:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364350592 00000100:00100000:0.0:1782607543.876516:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782607543.876521:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745509ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1869199364350464:12345-0@lo:400: 00000100:00100000:0.0:1782607543.876549:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745509ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1869199364350464:12345-0@lo:400: Request processed in 28us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607543.876555:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782607543.876564:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782607543.876570:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745509ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1869199364350592:12345-0@lo:400: 00000100:00100000:0.0:1782607543.876591:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745509ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1869199364350592:12345-0@lo:400: Request processed in 23us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607543.876596:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1782607543.876611:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782607543.876615:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782607543.876642:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1869199364350592:0@lo:400: 00000100:00100000:0.0:1782607543.876652:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1869199364350464:0@lo:400: 00010000:00080000:0.0:1782607543.876662:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97455d460e00 x1869199364350976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782607543.876683:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d460e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364350976:0@lo:400: 00000100:00100000:3.0:1782607543.876810:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364350720:0@lo:400: 00000100:00100000:3.0:1782607543.876841:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607543.876863:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fae11c6e-4506-4104-bb8c-df42498f7e08:3316:1869199364350336:0@lo:400: 00000100:00100000:3.0:1782607543.876874:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782607543.876887:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d463b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1869199364350848:0@lo:400: 00000100:00100000:3.0:1782607543.876926:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607543.876949:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364350848 00000100:00100000:3.0:1782607543.876952:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364350848 00000100:00100000:3.0:1782607543.876995:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782607543.877002:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580e51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869199364350848:12345-0@lo:400: 00000100:00100000:3.0:1782607543.877036:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580e51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869199364350848:12345-0@lo:400: Request processed in 34us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607543.877041:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1782607543.877057:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782607543.877317:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d463b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1869199364350848:0@lo:400: 00000100:00100000:0.0:1782607543.878504:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364350720 00000100:00100000:0.0:1782607543.878512:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364350720 00000100:00100000:0.0:1782607543.878582:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782607543.878590:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580e52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364350720:12345-0@lo:400: 00000100:00100000:0.0:1782607543.878652:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580e52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364350720:12345-0@lo:400: Request processed in 63us (1810us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607543.878659:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1782607543.878872:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782607543.878917:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97455d462d80 x1869199364350720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607543.878931:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364350720:0@lo:400: 00000100:00100000:0.0:1782607544.385938:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782607544.385967:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364351104:0@lo:13: 00000100:00100000:0.0:1782607544.386039:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607544.386136:0:6613:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364351104 00000100:00100000:0.0:1782607544.386143:0:6613:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364351104 00000100:00100000:0.0:1782607544.386200:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782607544.386210:0:6613:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745509eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364351104:12345-0@lo:13: 00002000:00000024:0.0:1782607544.386233:0:6613:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782607544.386273:0:6613:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745509eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364351104:12345-0@lo:13: Request processed in 64us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607544.386280:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1782607544.386316:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9745509ec380 x1869199364351104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607560 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782607544.386452:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364351104:0@lo:13: 00010000:00010000:2.0:1782607544.514546:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1782607544.985156:0:7525:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d72d7fb9-639f-4ad9-b658-df715cbf7792 00000100:00100000:1.0:1782607545.410072:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782607545.410098:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364351232:0@lo:13: 00000100:00100000:1.0:1782607545.410165:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607545.410661:0:6613:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364351232 00000100:00100000:0.0:1782607545.410670:0:6613:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364351232 00000100:00100000:0.0:1782607545.410743:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782607545.410754:0:6613:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364351232:12345-0@lo:13: 00002000:00000024:0.0:1782607545.410828:0:6613:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782607545.410882:0:6613:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364351232:12345-0@lo:13: Request processed in 129us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607545.410901:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1782607545.410922:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97455d462d80 x1869199364351232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607561 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607545.410943:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364351232:0@lo:13: 00000100:00080000:2.0:1782607545.411258:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1782607545.495350:0:5825:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d72d7fb9-639f-4ad9-b658-df715cbf7792 00010000:00010000:3.0:1782607545.538069:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607546.562175:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607546.607394:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607546.607437:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607546.607467:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607546.607494:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607546.607524:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342309120 00000100:00100000:1.0:1782607546.607534:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342309120 00000100:00100000:1.0:1782607546.607593:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 25 00000100:00100000:1.0:1782607546.607604:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2355:x1869199342309120:12345-192.168.202.4@tcp:400: 00000100:00100000:0.0:1782607546.607798:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342309248 00000100:00100000:0.0:1782607546.607802:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342309248 00000100:00100000:0.0:1782607546.607832:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342309376 00000100:00100000:0.0:1782607546.607835:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342309376 00000100:00100000:0.0:1782607546.607861:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 10 00000100:00100000:0.0:1782607546.607870:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2355:x1869199342309248:12345-192.168.202.4@tcp:400: 00000100:00100000:0.0:1782607546.607897:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2355:x1869199342309248:12345-192.168.202.4@tcp:400: Request processed in 30us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607546.607905:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 10 00000100:00100000:0.0:1782607546.607922:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11 00000100:00100000:0.0:1782607546.607928:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2355:x1869199342309376:12345-192.168.202.4@tcp:400: 00000100:00100000:0.0:1782607546.607948:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2355:x1869199342309376:12345-192.168.202.4@tcp:400: Request processed in 20us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607546.607954:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11 00000100:00080000:0.0:1782607546.607985:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782607546.607989:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782607546.607992:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782607546.608380:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2355:x1869199342309120:12345-192.168.202.4@tcp:400: Request processed in 79us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607546.608389:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 25 00000100:00100000:3.0:1782607546.608516:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342308992 00000100:00100000:3.0:1782607546.608521:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342308992 00000100:00100000:3.0:1782607546.608561:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 129 00000100:00100000:3.0:1782607546.608568:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+10:2355:x1869199342308992:12345-192.168.202.4@tcp:400: 00000100:00100000:3.0:1782607546.608602:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+10:2355:x1869199342308992:12345-192.168.202.4@tcp:400: Request processed in 34us (1219us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607546.608620:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 129 00000001:02000400:0.0:1782607546.867821:0:8182:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1782607547.586015:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607548.612320:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607548.994120:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1869199364351488:0@lo:400: 00000100:00100000:1.0:1782607548.994226:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607548.994298:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364352000:0@lo:400: 00000100:00100000:1.0:1782607548.994326:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607548.994361:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782607548.994367:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d460e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1869199364351616:0@lo:400: 00000100:00100000:1.0:1782607548.994395:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607548.994433:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364352000 00000100:00100000:1.0:1782607548.994441:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364352000 00000100:00100000:1.0:1782607548.994501:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782607548.994510:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364352000:12345-0@lo:400: 00000100:00100000:1.0:1782607548.994576:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364352000:12345-0@lo:400: Request processed in 67us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607548.994598:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782607548.994624:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364351488 00000100:00100000:1.0:1782607548.994628:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364351488 00000100:00100000:1.0:1782607548.994650:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364351616 00000100:00100000:1.0:1782607548.994653:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364351616 00000100:00100000:1.0:1782607548.994673:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782607548.994680:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1869199364351488:12345-0@lo:400: 00000100:00100000:1.0:1782607548.994709:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1869199364351488:12345-0@lo:400: Request processed in 30us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607548.994715:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782607548.994727:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782607548.994734:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1869199364351616:12345-0@lo:400: 00000100:00100000:1.0:1782607548.994757:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1869199364351616:12345-0@lo:400: Request processed in 25us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607548.994762:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1782607548.994804:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782607548.994808:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782607548.994849:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d460e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1869199364351616:0@lo:400: 00000100:00100000:1.0:1782607548.994872:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1869199364351488:0@lo:400: 00010000:00080000:1.0:1782607548.994884:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97455d462d80 x1869199364352000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607548.994895:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364352000:0@lo:400: 00000100:00100000:3.0:1782607548.995258:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d463b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fae11c6e-4506-4104-bb8c-df42498f7e08:3317:1869199364351360:0@lo:400: 00000100:00100000:3.0:1782607548.995298:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607548.995335:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3317:1869199364351872:0@lo:400: 00000100:00100000:3.0:1782607548.995357:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607548.995376:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782607548.995382:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364351744:0@lo:400: 00000100:00100000:3.0:1782607548.995405:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607548.995433:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364351744 00000100:00100000:3.0:1782607548.995438:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364351744 00000100:00100000:3.0:1782607548.995471:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782607548.995478:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364351744:12345-0@lo:400: 00000100:00100000:3.0:1782607548.995512:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364351744:12345-0@lo:400: Request processed in 36us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607548.995518:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1782607548.995559:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97455d463800 x1869199364351744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607548.995570:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364351744:0@lo:400: 00000100:00100000:2.0:1782607548.995726:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364351872 00000100:00100000:2.0:1782607548.995731:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364351872 00000100:00100000:2.0:1782607548.995791:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782607548.995798:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580e51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869199364351872:12345-0@lo:400: 00000100:00100000:2.0:1782607548.995837:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580e51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869199364351872:12345-0@lo:400: Request processed in 41us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607548.995843:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782607548.995985:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3317:1869199364351872:0@lo:400: 00000100:00100000:1.0:1782607548.996056:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364351360 00000100:00100000:1.0:1782607548.996060:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364351360 00000100:00100000:1.0:1782607548.996094:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1782607548.996101:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3317:x1869199364351360:12345-0@lo:400: 00000100:00100000:1.0:1782607548.996164:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3317:x1869199364351360:12345-0@lo:400: Request processed in 63us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607548.996170:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:1.0:1782607548.996196:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782607548.996200:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782607548.996402:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d463b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fae11c6e-4506-4104-bb8c-df42498f7e08:3317:1869199364351360:0@lo:400: 00000100:00100000:1.0:1782607549.507827:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364352128:0@lo:13: 00000100:00100000:1.0:1782607549.507948:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607549.508065:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364352128 00000100:00100000:1.0:1782607549.508076:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364352128 00000100:00100000:1.0:1782607549.508157:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782607549.508168:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364352128:12345-0@lo:13: 00002000:00000024:1.0:1782607549.508226:0:6612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782607549.508288:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364352128:12345-0@lo:13: Request processed in 121us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607549.508296:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1782607549.508380:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9745509ec380 x1869199364352128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607565 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607549.508405:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364352128:0@lo:13: 00010000:00010000:3.0:1782607549.635743:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782607550.534235:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580e53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364352256:0@lo:13: 00000100:00100000:3.0:1782607550.534335:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607550.534445:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364352256 00000100:00100000:3.0:1782607550.534454:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364352256 00000100:00100000:3.0:1782607550.534520:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782607550.534543:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580e53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364352256:12345-0@lo:13: 00002000:00000024:3.0:1782607550.534581:0:6612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782607550.534625:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580e53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364352256:12345-0@lo:13: Request processed in 83us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607550.534631:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1782607550.534652:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782607550.534680:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974580e53800 x1869199364352256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607566 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607550.534698:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580e53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364352256:0@lo:13: 00010000:00010000:2.0:1782607550.657944:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782607550.875384:0:8329:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc46ec8230 20000000:00000080:2.0:1782607550.875479:0:8329:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97457f461c00 uarg=0000000000000000 20000000:01000000:2.0:1782607550.875531:0:8329:0:(mgs_llog.c:2004:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1782607550.875534:0:8329:0:(mgs_llog.c:6054:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1782607550.875537:0:8329:0:(mgs_llog.c:6085:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1782607550.875543:0:8329:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1782607550.875548:0:8329:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1782607550.875563:0:8329:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1782607550.875565:0:8329:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1782607550.876120:0:8329:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1782607550.876124:0:8329:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1782607550.878296:0:8330:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1782607550.879487:0:8329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1782607550.879542:0:8329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1782607550.879562:0:8329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:0.0:1782607550.879573:0:8329:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1782607550.879574:0:8329:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1782607550.880520:0:8331:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1782607550.881219:0:8329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1782607550.881257:0:8329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1782607550.881285:0:8329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1782607550.881293:0:8329:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1782607550.881295:0:8329:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1782607550.881825:0:8332:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1782607550.882269:0:8329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1782607550.882297:0:8329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1782607550.882314:0:8329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1782607550.882323:0:8329:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1782607550.882324:0:8329:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1782607550.883022:0:8333:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1782607550.883341:0:8329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1782607550.883373:0:8329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1782607550.883392:0:8329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:1.0:1782607550.883457:0:8329:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1782607550.883476:0:8329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9745821d0200/0x8109266df35cb11e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607550.883494:0:8329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff974540031400/0x8109266df35cb01b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cb014 expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607550.883499:0:8329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff974540031e00/0x8109266df35cb045 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cb03e expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607550.883504:0:8329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff974540031200/0x8109266df35cb06f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cb068 expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607550.883507:0:8329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff974582051600/0x8109266df35cb07d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cb076 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607550.883511:0:8329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff974540030800/0x8109266df35cb08b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cb084 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607550.883515:0:8329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff974582050600/0x8109266df35cb0a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cb0a0 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607550.883518:0:8329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff974582050a00/0x8109266df35cb0d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cb0ca expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607550.883525:0:8329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9745821d1600/0x8109266df35cb0df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffb83 expref: 9 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607550.883528:0:8329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff974582050400/0x8109266df35cb0e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffb8a expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607550.883533:0:8329:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9745821d0200/0x8109266df35cb11e lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607550.883583:0:8329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff974582050400/0x8109266df35cb0e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffb8a expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607550.883597:0:8329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff974582050400/0x8109266df35cb0e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffb8a expref: 9 pid: 5797 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607550.883612:0:8329:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974548948e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8329:1869199364352384:192.168.202.4@tcp:104: 00010000:00010000:1.0:1782607550.883809:0:8329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9745821d1600/0x8109266df35cb0df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffb83 expref: 9 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607550.883815:0:8329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9745821d1600/0x8109266df35cb0df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffb83 expref: 9 pid: 5795 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607550.883821:0:8329:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974548948700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8329:1869199364352512:192.168.202.4@tcp:104: 00010000:00010000:1.0:1782607550.884012:0:8329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff974582050a00/0x8109266df35cb0d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8109266df35cb0ca expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607550.884018:0:8329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff974582050a00/0x8109266df35cb0d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8109266df35cb0ca expref: 18 pid: 5797 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607550.884025:0:8329:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974548948380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8329:1869199364352640:0@lo:104: 00000100:00100000:1.0:1782607550.884064:0:8329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782607550.884096:0:8329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff974582050600/0x8109266df35cb0a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8109266df35cb0a0 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607550.884103:0:8329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff974582050600/0x8109266df35cb0a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8109266df35cb0a0 expref: 18 pid: 5797 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607550.884123:0:8329:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974548948000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8329:1869199364352768:0@lo:104: 00000100:00100000:1.0:1782607550.884156:0:8329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782607550.884296:0:8329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff974540030800/0x8109266df35cb08b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8109266df35cb084 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607550.884302:0:8329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff974540030800/0x8109266df35cb08b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8109266df35cb084 expref: 18 pid: 5798 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607550.884307:0:8329:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974548949180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8329:1869199364352896:0@lo:104: 00010000:00010000:1.0:1782607550.884323:0:8329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff974582051600/0x8109266df35cb07d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8109266df35cb076 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607550.884328:0:8329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff974582051600/0x8109266df35cb07d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8109266df35cb076 expref: 18 pid: 5798 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607550.884332:0:8329:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97454894a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8329:1869199364353024:0@lo:104: 00010000:00010000:1.0:1782607550.884343:0:8329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff974540031200/0x8109266df35cb06f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8109266df35cb068 expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607550.884347:0:8329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff974540031200/0x8109266df35cb06f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8109266df35cb068 expref: 18 pid: 5795 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607550.884351:0:8329:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974548949880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8329:1869199364353152:0@lo:104: 00010000:00010000:1.0:1782607550.884361:0:8329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff974540031e00/0x8109266df35cb045 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8109266df35cb03e expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607550.884366:0:8329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff974540031e00/0x8109266df35cb045 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8109266df35cb03e expref: 18 pid: 5798 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607550.884379:0:8329:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97454894aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8329:1869199364353280:0@lo:104: 00010000:00010000:1.0:1782607550.884395:0:8329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff974540031400/0x8109266df35cb01b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8109266df35cb014 expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607550.884400:0:8329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff974540031400/0x8109266df35cb01b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8109266df35cb014 expref: 18 pid: 5795 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607550.884414:0:8329:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97454894b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8329:1869199364353408:0@lo:104: 00000100:00100000:1.0:1782607550.884423:0:8329:0:(client.c:2701:ptlrpc_set_wait()) set ffff97455d443e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782607550.885239:0:5785:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1782607550.885263:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607550.885276:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607550.885284:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607550.885292:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607550.885309:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607550.885317:0:5785:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364352640 00000100:00100000:2.0:1782607550.885323:0:5785:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364352640 00000100:00100000:2.0:1782607550.885357:0:5785:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364352768 00000100:00100000:2.0:1782607550.885360:0:5785:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364352768 00000100:00100000:2.0:1782607550.885369:0:5785:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364352896 00000100:00100000:2.0:1782607550.885371:0:5785:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364352896 00000100:00100000:2.0:1782607550.885379:0:5785:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364353024 00000100:00100000:2.0:1782607550.885381:0:5785:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364353024 00000100:00100000:2.0:1782607550.885389:0:5785:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364353152 00000100:00100000:2.0:1782607550.885391:0:5785:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364353152 00000100:00100000:2.0:1782607550.885399:0:5785:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364353280 00000100:00100000:2.0:1782607550.885470:0:5785:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364353280 00000100:00100000:2.0:1782607550.885488:0:5785:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364353408 00000100:00100000:2.0:1782607550.885491:0:5785:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364353408 00000100:00100000:2.0:1782607550.885503:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782607550.885510:0:5785:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974548948a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+9:8329:x1869199364352640:12345-0@lo:104: 00010000:00010000:2.0:1782607550.885525:0:5785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff9745585ac400/0x8109266df35cb0ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cb0d1 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607550.885669:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782607550.885675:0:5785:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974548948a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+9:8329:x1869199364352640:12345-0@lo:104: Request processed in 166us (1610us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607550.885682:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782607550.885698:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782607550.885703:0:5785:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f58e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+8:8329:x1869199364352768:12345-0@lo:104: 00010000:00010000:2.0:1782607550.885710:0:5785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff9745585ad000/0x8109266df35cb0a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cb0a7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607550.885738:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782607550.885742:0:5785:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f58e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+8:8329:x1869199364352768:12345-0@lo:104: Request processed in 39us (1586us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607550.885754:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782607550.885804:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782607550.885811:0:5785:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455d463b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+7:8329:x1869199364352896:12345-0@lo:104: 00010000:00010000:2.0:1782607550.885818:0:5785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff974582050c00/0x8109266df35cb084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cb08b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607550.886126:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1782607550.886143:0:5785:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455d463b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+7:8329:x1869199364352896:12345-0@lo:104: Request processed in 332us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607550.886149:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782607550.886163:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782607550.886169:0:5785:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455d462680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+6:8329:x1869199364353024:12345-0@lo:104: 00010000:00010000:2.0:1782607550.886176:0:5785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff974582050e00/0x8109266df35cb076 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cb07d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607550.886210:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1782607550.886215:0:5785:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455d462680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+6:8329:x1869199364353024:12345-0@lo:104: Request processed in 47us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607550.886220:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782607550.886232:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782607550.886237:0:5785:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455d463800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+5:8329:x1869199364353152:12345-0@lo:104: 00010000:00010000:2.0:1782607550.886243:0:5785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff9745821d1400/0x8109266df35cb068 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cb06f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607550.886267:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1782607550.886271:0:5785:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455d463800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+5:8329:x1869199364353152:12345-0@lo:104: Request processed in 35us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607550.886281:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782607550.886292:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782607550.886296:0:5785:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455d462d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+4:8329:x1869199364353280:12345-0@lo:104: 00010000:00010000:2.0:1782607550.886302:0:5785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff974582050000/0x8109266df35cb03e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cb045 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607550.886324:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1782607550.886327:0:5785:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455d462d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+4:8329:x1869199364353280:12345-0@lo:104: Request processed in 32us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607550.886331:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782607550.886340:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782607550.886344:0:5785:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455d461500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+3:8329:x1869199364353408:12345-0@lo:104: 00010000:00010000:2.0:1782607550.886350:0:5785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff974582051a00/0x8109266df35cb014 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cb01b expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607550.886368:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1782607550.886371:0:5785:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455d461500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+3:8329:x1869199364353408:12345-0@lo:104: Request processed in 27us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607550.886375:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1782607550.886391:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1782607550.886396:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff9745585ac400/0x8109266df35cb0ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cb0d1 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607550.886401:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ac400 already unused, calling callback (ffffffffc1db0c20) 10000000:00010000:2.0:1782607550.886751:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff9745585ac400/0x8109266df35cb0ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x8109266df35cb0d1 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607550.888159:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff9745585ac400/0x8109266df35cb0ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x8109266df35cb0d1 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782607550.888167:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff9745585ac400/0x8109266df35cb0ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x8109266df35cb0d1 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782607550.888174:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782607550.888235:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff9745585ac400/0x8109266df35cb0ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cb0d1 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607550.888241:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782607550.888259:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff9745585ac400/0x8109266df35cb0ca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cb0d1 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607550.888266:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff9745585ac400/0x8109266df35cb0ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cb0d1 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607550.888284:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1782607550.888289:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff9745585ad000/0x8109266df35cb0a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cb0a7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607550.888295:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ad000 already unused, calling callback (ffffffffc1db0c20) 10000000:00010000:2.0:1782607550.888298:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff9745585ad000/0x8109266df35cb0a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x8109266df35cb0a7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607550.888304:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff9745585ad000/0x8109266df35cb0a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x8109266df35cb0a7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782607550.888311:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff9745585ad000/0x8109266df35cb0a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x8109266df35cb0a7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782607550.888326:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782607550.888343:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff9745585ad000/0x8109266df35cb0a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cb0a7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607550.888348:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782607550.888365:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff9745585ad000/0x8109266df35cb0a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cb0a7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607550.888372:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff9745585ad000/0x8109266df35cb0a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cb0a7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607550.888381:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1782607550.888384:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974582050c00/0x8109266df35cb084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cb08b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607550.888389:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974582050c00 already unused, calling callback (ffffffffc1db0c20) 10000000:00010000:2.0:1782607550.888392:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974582050c00/0x8109266df35cb084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x8109266df35cb08b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607550.888399:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974582050c00/0x8109266df35cb084 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x8109266df35cb08b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782607550.888611:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974582050c00/0x8109266df35cb084 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x8109266df35cb08b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782607550.888616:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782607550.888632:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974582050c00/0x8109266df35cb084 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cb08b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607550.888638:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782607550.888650:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974582050c00/0x8109266df35cb084 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cb08b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607550.888656:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974582050c00/0x8109266df35cb084 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cb08b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607550.888825:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1782607550.888830:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974582050e00/0x8109266df35cb076 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cb07d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607550.888901:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974582050e00 already unused, calling callback (ffffffffc1db0c20) 10000000:00010000:2.0:1782607550.888904:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974582050e00/0x8109266df35cb076 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8109266df35cb07d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607550.888912:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974582050e00/0x8109266df35cb076 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8109266df35cb07d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782607550.888918:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974582050e00/0x8109266df35cb076 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8109266df35cb07d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782607550.888922:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782607550.888937:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974582050e00/0x8109266df35cb076 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cb07d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607550.888943:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782607550.888949:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974582050e00/0x8109266df35cb076 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cb07d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607550.888955:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974582050e00/0x8109266df35cb076 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cb07d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607550.888965:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1782607550.888974:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff9745821d1400/0x8109266df35cb068 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cb06f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607550.888980:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745821d1400 already unused, calling callback (ffffffffc1db0c20) 10000000:00010000:2.0:1782607550.888983:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff9745821d1400/0x8109266df35cb068 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8109266df35cb06f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607550.888990:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff9745821d1400/0x8109266df35cb068 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8109266df35cb06f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782607550.888996:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff9745821d1400/0x8109266df35cb068 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8109266df35cb06f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782607550.889001:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782607550.889014:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff9745821d1400/0x8109266df35cb068 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cb06f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607550.889019:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782607550.889023:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff9745821d1400/0x8109266df35cb068 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cb06f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607550.889029:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff9745821d1400/0x8109266df35cb068 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cb06f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607550.889039:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782607550.889043:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974582050000/0x8109266df35cb03e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cb045 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607550.889115:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974582050000 already unused, calling callback (ffffffffc1db0c20) 10000000:00010000:2.0:1782607550.889118:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974582050000/0x8109266df35cb03e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8109266df35cb045 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607550.889146:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974582050000/0x8109266df35cb03e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8109266df35cb045 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782607550.889152:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974582050000/0x8109266df35cb03e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8109266df35cb045 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782607550.889157:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782607550.889172:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974582050000/0x8109266df35cb03e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cb045 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607550.889179:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782607550.889184:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974582050000/0x8109266df35cb03e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cb045 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607550.889189:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974582050000/0x8109266df35cb03e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cb045 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607550.889198:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782607550.889201:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974582051a00/0x8109266df35cb014 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cb01b expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607550.889206:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974582051a00 already unused, calling callback (ffffffffc1db0c20) 10000000:00010000:2.0:1782607550.889209:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974582051a00/0x8109266df35cb014 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8109266df35cb01b expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607550.889215:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974582051a00/0x8109266df35cb014 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8109266df35cb01b expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782607550.889221:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974582051a00/0x8109266df35cb014 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8109266df35cb01b expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782607550.889232:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782607550.889262:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974582051a00/0x8109266df35cb014 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cb01b expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607550.889269:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782607550.889274:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974582051a00/0x8109266df35cb014 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cb01b expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607550.889280:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974582051a00/0x8109266df35cb014 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cb01b expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607550.889294:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607550.889296:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607550.889298:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782607550.889318:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581539f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fae11c6e-4506-4104-bb8c-df42498f7e08:3318:1869199364353664:0@lo:103: 00000100:00100000:2.0:1782607550.889391:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782607550.889594:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607550.889601:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782607550.889611:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d460e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fae11c6e-4506-4104-bb8c-df42498f7e08:3317:1869199364353536:0@lo:103: 00000100:00100000:3.0:1782607550.889643:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581538380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fae11c6e-4506-4104-bb8c-df42498f7e08:3316:1869199364353920:0@lo:103: 00000100:00100000:3.0:1782607550.889807:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97458153aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364353792:0@lo:103: 00000100:00100000:2.0:1782607550.890163:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97458153a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fae11c6e-4506-4104-bb8c-df42498f7e08:3318:1869199364354176:0@lo:103: 00000100:00100000:2.0:1782607550.890187:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607550.890385:0:8329:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974548948380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8329:1869199364352640:0@lo:104: 00000100:00100000:1.0:1782607550.890430:0:8329:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974548948000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8329:1869199364352768:0@lo:104: 00000100:00100000:1.0:1782607550.890439:0:8329:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974548949180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8329:1869199364352896:0@lo:104: 00000100:00100000:1.0:1782607550.890447:0:8329:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97454894a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8329:1869199364353024:0@lo:104: 00000100:00100000:1.0:1782607550.890455:0:8329:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974548949880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8329:1869199364353152:0@lo:104: 00000100:00100000:1.0:1782607550.890464:0:8329:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97454894aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8329:1869199364353280:0@lo:104: 00000100:00100000:1.0:1782607550.890473:0:8329:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97454894b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8329:1869199364353408:0@lo:104: 00000100:00100000:3.0:1782607550.891165:0:8329:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974548948e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8329:1869199364352384:192.168.202.4@tcp:104: 00000100:00100000:3.0:1782607550.891176:0:8329:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974548948700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8329:1869199364352512:192.168.202.4@tcp:104: 00010000:00010000:3.0:1782607550.891221:0:8329:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9745821d0200/0x8109266df35cb11e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607550.891559:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607550.891608:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364353664 00000100:00100000:0.0:1782607550.891615:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364353664 00010000:00010000:0.0:1782607550.891647:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff974582050600/0x8109266df35cb0a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cb0a0 expref: 19 pid: 5797 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607550.891997:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581538a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fae11c6e-4506-4104-bb8c-df42498f7e08:3317:1869199364354048:0@lo:103: 00000100:00100000:2.0:1782607550.892038:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607550.892174:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364354176 00000100:00100000:1.0:1782607550.892179:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364354176 00010000:00010000:1.0:1782607550.892198:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff974540031e00/0x8109266df35cb045 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cb03e expref: 20 pid: 5798 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607550.892213:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364353536 00000100:00100000:1.0:1782607550.892216:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364353536 00010000:00010000:1.0:1782607550.892226:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff974582050a00/0x8109266df35cb0d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cb0ca expref: 21 pid: 5797 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607550.892264:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782607550.892273:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974567327800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+21:3318:x1869199364353664:12345-0@lo:103: 00010000:00010000:1.0:1782607550.892286:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782607550.892291:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff974582050600/0x8109266df35cb0a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cb0a0 expref: 21 pid: 5797 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607550.892300:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff974582050600/0x8109266df35cb0a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8109266df35cb0a0 expref: 21 pid: 5797 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607550.892316:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974582050600/0x8109266df35cb0a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8109266df35cb0a0 expref: 21 pid: 5797 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607550.892333:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782607550.892381:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974567327800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+20:3318:x1869199364353664:12345-0@lo:103: Request processed in 109us (2989us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607550.892387:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782607550.892416:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782607550.892423:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974567324e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3318:x1869199364354176:12345-0@lo:103: 00010000:00010000:1.0:1782607550.892430:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782607550.892434:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff974540031e00/0x8109266df35cb045 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cb03e expref: 19 pid: 5798 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607550.892442:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff974540031e00/0x8109266df35cb045 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8109266df35cb03e expref: 19 pid: 5798 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607550.892452:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974540031e00/0x8109266df35cb045 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8109266df35cb03e expref: 19 pid: 5798 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607550.892471:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782607550.892496:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974567324e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+18:3318:x1869199364354176:12345-0@lo:103: Request processed in 73us (2309us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607550.892502:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782607550.892515:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782607550.892521:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974567324700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+17:3317:x1869199364353536:12345-0@lo:103: 00010000:00010000:1.0:1782607550.892528:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782607550.892531:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff974582050a00/0x8109266df35cb0d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cb0ca expref: 17 pid: 5797 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607550.892538:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff974582050a00/0x8109266df35cb0d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8109266df35cb0ca expref: 17 pid: 5797 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607550.892546:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974582050a00/0x8109266df35cb0d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8109266df35cb0ca expref: 17 pid: 5797 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607550.892553:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782607550.892572:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974567324700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+16:3317:x1869199364353536:12345-0@lo:103: Request processed in 52us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607550.892577:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782607550.892607:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581539f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fae11c6e-4506-4104-bb8c-df42498f7e08:3318:1869199364353664:0@lo:103: 00000100:00100000:1.0:1782607550.892615:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97458153a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fae11c6e-4506-4104-bb8c-df42498f7e08:3318:1869199364354176:0@lo:103: 00000100:00100000:2.0:1782607550.893331:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d460e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fae11c6e-4506-4104-bb8c-df42498f7e08:3317:1869199364353536:0@lo:103: 00000100:00100000:2.0:1782607550.893460:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607550.893550:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607550.893564:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364354048 00000100:00100000:1.0:1782607550.893569:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364354048 00010000:00010000:1.0:1782607550.893588:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff974540031200/0x8109266df35cb06f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cb068 expref: 16 pid: 5795 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607550.893635:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364353920 00000100:00100000:0.0:1782607550.893638:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364353920 00010000:00010000:0.0:1782607550.893655:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff974582051600/0x8109266df35cb07d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cb076 expref: 17 pid: 5798 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607550.893691:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782607550.893697:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974567324380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+17:3317:x1869199364354048:12345-0@lo:103: 00010000:00010000:0.0:1782607550.893707:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782607550.893711:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff974540031200/0x8109266df35cb06f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cb068 expref: 17 pid: 5795 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607550.893719:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff974540031200/0x8109266df35cb06f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8109266df35cb068 expref: 17 pid: 5795 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607550.893730:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974540031200/0x8109266df35cb06f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8109266df35cb068 expref: 17 pid: 5795 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607550.893740:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782607550.893800:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974567324380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+16:3317:x1869199364354048:12345-0@lo:103: Request processed in 103us (1761us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607550.893816:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782607550.893829:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782607550.893844:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974567324a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+15:3316:x1869199364353920:12345-0@lo:103: 00010000:00010000:0.0:1782607550.893852:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782607550.893856:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff974582051600/0x8109266df35cb07d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cb076 expref: 15 pid: 5798 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607550.893864:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff974582051600/0x8109266df35cb07d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8109266df35cb076 expref: 15 pid: 5798 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607550.893874:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974582051600/0x8109266df35cb07d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8109266df35cb076 expref: 15 pid: 5798 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607550.893882:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782607550.893907:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974567324a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+14:3316:x1869199364353920:12345-0@lo:103: Request processed in 73us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607550.893912:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782607550.893936:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581538a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fae11c6e-4506-4104-bb8c-df42498f7e08:3317:1869199364354048:0@lo:103: 00000100:00100000:0.0:1782607550.893954:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581538380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fae11c6e-4506-4104-bb8c-df42498f7e08:3316:1869199364353920:0@lo:103: 00000100:00100000:2.0:1782607550.894253:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364354304:0@lo:103: 00000100:00100000:2.0:1782607550.894281:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607550.894326:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607550.894371:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607550.894433:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364353792 00000100:00100000:3.0:1782607550.894437:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364353792 00010000:00010000:3.0:1782607550.894456:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff974540030800/0x8109266df35cb08b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cb084 expref: 14 pid: 5798 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607550.894469:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364354304 00000100:00100000:3.0:1782607550.894471:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364354304 00010000:00010000:3.0:1782607550.894487:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff974540031400/0x8109266df35cb01b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cb014 expref: 15 pid: 5795 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607550.894497:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342309504 00000100:00100000:3.0:1782607550.894499:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342309504 00010000:00010000:3.0:1782607550.894510:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff974582050400/0x8109266df35cb0e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffb8a expref: 10 pid: 5797 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607550.894520:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342309632 00000100:00100000:3.0:1782607550.894523:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342309632 00010000:00010000:3.0:1782607550.894533:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9745821d1600/0x8109266df35cb0df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffb83 expref: 11 pid: 5795 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607550.894546:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782607550.894551:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974567324000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fae11c6e-4506-4104-bb8c-df42498f7e08+15:3319:x1869199364353792:12345-0@lo:103: 00010000:00010000:3.0:1782607550.894559:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782607550.894563:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff974540030800/0x8109266df35cb08b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cb084 expref: 15 pid: 5798 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607550.894571:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff974540030800/0x8109266df35cb08b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8109266df35cb084 expref: 15 pid: 5798 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607550.894581:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974540030800/0x8109266df35cb08b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8109266df35cb084 expref: 15 pid: 5798 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607550.894590:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782607550.894627:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974567324000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fae11c6e-4506-4104-bb8c-df42498f7e08+14:3319:x1869199364353792:12345-0@lo:103: Request processed in 75us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607550.894633:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782607550.894647:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782607550.894653:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974567325180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fae11c6e-4506-4104-bb8c-df42498f7e08+13:3319:x1869199364354304:12345-0@lo:103: 00010000:00010000:3.0:1782607550.894678:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782607550.894691:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff974540031400/0x8109266df35cb01b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cb014 expref: 13 pid: 5795 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607550.894700:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff974540031400/0x8109266df35cb01b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8109266df35cb014 expref: 13 pid: 5795 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607550.894710:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974540031400/0x8109266df35cb01b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8109266df35cb014 expref: 13 pid: 5795 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607550.894718:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782607550.894740:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974567325180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fae11c6e-4506-4104-bb8c-df42498f7e08+12:3319:x1869199364354304:12345-0@lo:103: Request processed in 88us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607550.894746:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782607550.894759:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 19 00000100:00100000:3.0:1782607550.894790:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974548807850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+11:2357:x1869199342309504:12345-192.168.202.4@tcp:103: 00010000:00010000:3.0:1782607550.894799:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782607550.894804:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff974582050400/0x8109266df35cb0e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffb8a expref: 11 pid: 5797 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607550.894812:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff974582050400/0x8109266df35cb0e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffb8a expref: 11 pid: 5797 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607550.894821:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974582050400/0x8109266df35cb0e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffb8a expref: 11 pid: 5797 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607550.894829:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782607550.894977:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974548807850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+10:2357:x1869199342309504:12345-192.168.202.4@tcp:103: Request processed in 211us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607550.894993:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 19 00000100:00100000:3.0:1782607550.895026:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 20 00000100:00100000:3.0:1782607550.895032:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974567326680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+9:2356:x1869199342309632:12345-192.168.202.4@tcp:103: 00010000:00010000:3.0:1782607550.895039:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782607550.895043:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9745821d1600/0x8109266df35cb0df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffb83 expref: 9 pid: 5795 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607550.895065:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9745821d1600/0x8109266df35cb0df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffb83 expref: 9 pid: 5795 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607550.895075:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9745821d1600/0x8109266df35cb0df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffb83 expref: 9 pid: 5795 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607550.895087:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9745821d0200/0x8109266df35cb11e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607550.895095:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9745821d0200/0x8109266df35cb11e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607550.895110:0:5789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9745821d0200/0x8109266df35cb11e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607550.895117:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9745821d0200/0x8109266df35cb11e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607550.895124:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9745821d0200/0x8109266df35cb11e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607550.895142:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9745821d0200/0x8109266df35cb11e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607550.895154:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745821d0200 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:3.0:1782607550.895158:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9745821d0200/0x8109266df35cb11e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607550.895166:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9745821d0200/0x8109266df35cb11e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607550.895181:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9745821d0200/0x8109266df35cb11e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607550.895192:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782607550.895211:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974567326680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+8:2356:x1869199342309632:12345-192.168.202.4@tcp:103: Request processed in 179us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607550.895218:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 20 00010000:00010000:3.0:1782607550.895244:0:8329:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9745821d0200/0x8109266df35cb11e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607550.895252:0:8329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9745821d0200/0x8109266df35cb11e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607550.895259:0:8329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9745821d0200/0x8109266df35cb11e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607550.899116:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97458153aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364353792:0@lo:103: 00000100:00100000:3.0:1782607550.899142:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364354304:0@lo:103: 00010000:00010000:2.0:1782607551.682150:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782607551.720848:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607551.720888:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607551.720912:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607551.720972:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607551.720974:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342310144 00000100:00100000:0.0:1782607551.720985:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342310144 00000100:00100000:3.0:1782607551.720997:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342310016 00000100:00100000:3.0:1782607551.721002:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342310016 00000100:00100000:3.0:1782607551.721053:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 14 00000100:00100000:3.0:1782607551.721063:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974551143800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2354:x1869199342310016:12345-192.168.202.4@tcp:400: 00000100:00100000:3.0:1782607551.721140:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974551143800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2354:x1869199342310016:12345-192.168.202.4@tcp:400: Request processed in 78us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607551.721147:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 14 00000100:00100000:3.0:1782607551.721161:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15 00000100:00100000:3.0:1782607551.721167:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580e53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2354:x1869199342310144:12345-192.168.202.4@tcp:400: 00000100:00100000:3.0:1782607551.721186:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580e53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2354:x1869199342310144:12345-192.168.202.4@tcp:400: Request processed in 20us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607551.721192:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15 00000100:00100000:1.0:1782607551.721253:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342309888 00000100:00100000:1.0:1782607551.721257:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342309888 00000100:00100000:1.0:1782607551.721288:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 29 00000100:00100000:2.0:1782607551.721583:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342309760 00000100:00100000:2.0:1782607551.721588:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342309760 00000100:00100000:2.0:1782607551.721622:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 131 00000100:00100000:2.0:1782607551.721630:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+8:2354:x1869199342309760:12345-192.168.202.4@tcp:400: 00000100:00100000:2.0:1782607551.721661:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+8:2354:x1869199342309760:12345-192.168.202.4@tcp:400: Request processed in 32us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607551.721667:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 131 00000100:00080000:2.0:1782607551.721857:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782607551.721862:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782607551.721864:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782607551.722318:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580e53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2354:x1869199342309888:12345-192.168.202.4@tcp:400: 00000100:00100000:1.0:1782607551.722359:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580e53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2354:x1869199342309888:12345-192.168.202.4@tcp:400: Request processed in 48us (1520us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607551.722365:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 29 00010000:00010000:3.0:1782607552.706493:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782607552.898585:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1782607552.898595:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff97457f5e0000 from 39 10000000:01000000:1.0:1782607552.898601:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782607552.898657:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9745821d1e00/0x8109266df35cb125 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607552.898669:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff9745821d1e00/0x8109266df35cb125 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607552.898679:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff9745821d1e00/0x8109266df35cb125 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607552.898703:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97454894a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364354432:0@lo:101: 00000100:00100000:1.0:1782607552.898802:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607552.898919:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff97455d443e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782607552.899569:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364354432 00000100:00100000:3.0:1782607552.899577:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364354432 00000100:00100000:3.0:1782607552.899678:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1782607552.899688:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+12:5800:x1869199364354432:12345-0@lo:101: 00010000:00010000:3.0:1782607552.899703:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607552.899717:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97455d648000/0x8109266df35cb12c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cb125 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607552.899740:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97455d648000/0x8109266df35cb12c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cb125 expref: 13 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607552.899751:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97455d648000/0x8109266df35cb12c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cb125 expref: 13 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607552.899800:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97455d648000, rc 0) 00000100:00100000:3.0:1782607552.899855:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+13:5800:x1869199364354432:12345-0@lo:101: Request processed in 168us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607552.899862:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1782607552.899942:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97454894a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364354432:0@lo:101: 00010000:00010000:1.0:1782607552.899957:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff9745821d1e00/0x8109266df35cb125 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb12c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607552.899966:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff9745821d1e00/0x8109266df35cb125 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cb12c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607552.900033:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97454894a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364354560:0@lo:501: 00000100:00100000:1.0:1782607552.900062:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607552.900491:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff97455d443e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782607552.900748:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364354560 00000100:00100000:2.0:1782607552.900754:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364354560 00000100:00100000:2.0:1782607552.900801:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1782607552.900808:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+13:5800:x1869199364354560:12345-0@lo:501: 00000100:00100000:2.0:1782607552.901288:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+13:5800:x1869199364354560:12345-0@lo:501: Request processed in 479us (1224us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607552.901297:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1782607552.901494:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97454894a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364354560:0@lo:501: 00000100:00100000:1.0:1782607552.901536:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97454894a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364354688:0@lo:503: 00000100:00100000:1.0:1782607552.901579:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607552.901599:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff97455d443e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782607552.901658:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364354688 00000100:00100000:2.0:1782607552.901662:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364354688 00000100:00100000:2.0:1782607552.901700:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1782607552.901707:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+13:5800:x1869199364354688:12345-0@lo:503: 00000100:00100000:2.0:1782607552.901869:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+13:5800:x1869199364354688:12345-0@lo:503: Request processed in 162us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607552.901876:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1782607552.901958:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97454894a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364354688:0@lo:503: 00000100:00100000:1.0:1782607552.902664:0:8345:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97454894a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:8345:1869199364354816:0@lo:502: 00000100:00100000:1.0:1782607552.902707:0:8345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607552.902738:0:8345:0:(client.c:2701:ptlrpc_set_wait()) set ffff97455d443e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782607552.902798:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364354816 00000100:00100000:2.0:1782607552.902809:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364354816 00000100:00100000:2.0:1782607552.902843:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1782607552.902850:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+13:8345:x1869199364354816:12345-0@lo:502: 00000100:00100000:2.0:1782607552.903338:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+13:8345:x1869199364354816:12345-0@lo:502: Request processed in 487us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607552.903347:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1782607552.903639:0:8345:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97454894a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:8345:1869199364354816:0@lo:502: 00000100:00100000:1.0:1782607552.903702:0:8345:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97454894a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:8345:1869199364354944:0@lo:502: 00000100:00100000:1.0:1782607552.903738:0:8345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607552.903814:0:8345:0:(client.c:2701:ptlrpc_set_wait()) set ffff974544271180 going to sleep for 11 seconds 00000100:00100000:3.0:1782607552.903900:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364354944 00000100:00100000:3.0:1782607552.903905:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364354944 00000100:00100000:3.0:1782607552.903970:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1782607552.903978:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+13:8345:x1869199364354944:12345-0@lo:502: 00000100:00100000:3.0:1782607552.904360:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+13:8345:x1869199364354944:12345-0@lo:502: Request processed in 383us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607552.904368:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1782607552.904442:0:8345:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97454894a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:8345:1869199364354944:0@lo:502: 00000040:00080000:1.0:1782607552.904466:0:8345:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1782607552.905952:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1782607552.905984:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782607552.905996:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9745821d1e00/0x8109266df35cb125 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb12c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607552.906008:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff9745821d1e00/0x8109266df35cb125 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb12c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782607552.906033:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1782607552.906037:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1782607552.906039:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1782607552.906205:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974540031200/0x8109266df35cb133 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607552.906215:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974540031200/0x8109266df35cb133 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607552.906226:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974540031200/0x8109266df35cb133 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607552.906246:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364355072:0@lo:101: 00000100:00100000:0.0:1782607552.906297:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607552.906638:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff974578fe0480 going to sleep for 11 seconds 00000100:00100000:2.0:1782607552.906712:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364355072 00000100:00100000:2.0:1782607552.906719:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364355072 00000100:00100000:2.0:1782607552.906756:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1782607552.906779:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+13:5800:x1869199364355072:12345-0@lo:101: 00010000:00010000:2.0:1782607552.906793:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607552.906806:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9745585ac400/0x8109266df35cb13a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cb133 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607552.906828:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9745585ac400/0x8109266df35cb13a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cb133 expref: 14 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607552.906838:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9745585ac400/0x8109266df35cb13a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cb133 expref: 14 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607552.906847:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585ac400, rc 0) 00000100:00100000:2.0:1782607552.906935:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+14:5800:x1869199364355072:12345-0@lo:101: Request processed in 171us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607552.906941:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1782607552.907261:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364355072:0@lo:101: 00010000:00010000:0.0:1782607552.907277:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974540031200/0x8109266df35cb133 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb13a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607552.907287:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974540031200/0x8109266df35cb133 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cb13a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607552.907344:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364355200:0@lo:501: 00000100:00100000:0.0:1782607552.907372:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607552.907432:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff974578fe0480 going to sleep for 11 seconds 00000100:00100000:1.0:1782607552.907463:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364355200 00000100:00100000:1.0:1782607552.907468:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364355200 00000100:00100000:2.0:1782607552.907510:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1782607552.907518:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+14:5800:x1869199364355200:12345-0@lo:501: 00000100:00100000:2.0:1782607552.907786:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+14:5800:x1869199364355200:12345-0@lo:501: Request processed in 269us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607552.907803:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1782607552.907881:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364355200:0@lo:501: 00000100:00100000:0.0:1782607552.907908:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364355328:0@lo:503: 00000100:00100000:0.0:1782607552.907950:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607552.907979:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff974578fe0480 going to sleep for 11 seconds 00000100:00100000:3.0:1782607552.908031:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364355328 00000100:00100000:3.0:1782607552.908036:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364355328 00000100:00100000:3.0:1782607552.908065:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1782607552.908253:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+14:5800:x1869199364355328:12345-0@lo:503: 00000100:00100000:3.0:1782607552.908417:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+14:5800:x1869199364355328:12345-0@lo:503: Request processed in 166us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607552.908468:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364355328:0@lo:503: 00000100:00100000:0.0:1782607552.908650:0:8346:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509ec000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:8346:1869199364355456:0@lo:502: 00000100:00100000:0.0:1782607552.908680:0:8346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607552.908689:0:8346:0:(client.c:2701:ptlrpc_set_wait()) set ffff974578fe0000 going to sleep for 11 seconds 00000100:00100000:1.0:1782607552.908990:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364355456 00000100:00100000:1.0:1782607552.908994:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364355456 00000100:00100000:3.0:1782607552.909355:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1782607552.909472:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1782607552.909483:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+14:8346:x1869199364355456:12345-0@lo:502: 00000100:00100000:1.0:1782607552.909666:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+14:8346:x1869199364355456:12345-0@lo:502: Request processed in 185us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607552.909673:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1782607552.909746:0:8346:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509ec000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:8346:1869199364355456:0@lo:502: 00000020:01000000:0.0:1782607552.909796:0:8346:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782607552.909807:0:8346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782607552.909809:0:8346:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1782607552.909815:0:8346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1782607552.909844:0:8346:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509ec000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:8346:1869199364355584:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782607552.909881:0:8346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607552.910040:0:8346:0:(client.c:2701:ptlrpc_set_wait()) set ffff974578fe0000 going to sleep for 11 seconds 00000100:00100000:2.0:1782607552.910367:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364355584 00000100:00100000:2.0:1782607552.910374:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364355584 00000100:00100000:2.0:1782607552.910401:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1782607552.910408:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974550829850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+14:8346:x1869199364355584:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782607552.910555:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974550829850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+14:8346:x1869199364355584:12345-0@lo:502:llog_process_th.0 Request processed in 146us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607552.910562:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1782607552.910649:0:8346:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509ec000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:8346:1869199364355584:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782607552.910670:0:8346:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782607552.910676:0:8346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782607552.910678:0:8346:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1782607552.910682:0:8346:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1782607552.910886:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1782607552.910904:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1782607552.910913:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974540031200/0x8109266df35cb133 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb13a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607552.910924:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974540031200/0x8109266df35cb133 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb13a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782607552.910935:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782607552.910938:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff97455053f000 from 39 10000000:01000000:2.0:1782607552.910941:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782607552.910966:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9745585ac800/0x8109266df35cb141 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607552.910975:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff9745585ac800/0x8109266df35cb141 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607552.910985:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff9745585ac800/0x8109266df35cb141 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607552.910999:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567325880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364355712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782607552.911033:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607552.911060:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff974578ff1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1782607552.911171:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364355712 00000100:00100000:0.0:1782607552.911176:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364355712 00000100:00100000:0.0:1782607552.911199:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1782607552.911204:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974550829050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+14:5800:x1869199364355712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782607552.911215:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607552.911228:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974540031400/0x8109266df35cb148 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cb141 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607552.911259:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974540031400/0x8109266df35cb148 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cb141 expref: 15 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607552.911270:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974540031400/0x8109266df35cb148 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cb141 expref: 15 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607552.911280:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974540031400, rc 0) 00000100:00100000:0.0:1782607552.911318:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974550829050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+15:5800:x1869199364355712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607552.911323:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1782607552.911387:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567325880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364355712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782607552.911399:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff9745585ac800/0x8109266df35cb141 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb148 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607552.911407:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff9745585ac800/0x8109266df35cb141 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cb148 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607552.911448:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567325880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364355840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782607552.911476:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607552.911497:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff974578ff1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1782607552.911795:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364355840 00000100:00100000:0.0:1782607552.911799:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364355840 00000100:00100000:0.0:1782607552.911817:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1782607552.911822:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+15:5800:x1869199364355840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782607552.912042:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+15:5800:x1869199364355840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 219us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607552.912048:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1782607552.912262:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567325880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364355840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782607552.912333:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567325880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364355968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782607552.912369:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607552.912392:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff974578ff1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1782607552.912436:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364355968 00000100:00100000:0.0:1782607552.912441:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364355968 00000100:00100000:0.0:1782607552.912459:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1782607552.912465:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+15:5800:x1869199364355968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782607552.912598:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+15:5800:x1869199364355968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 132us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607552.912605:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1782607552.912673:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567325880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364355968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782607552.913020:0:8347:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567325880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:8347:1869199364356096:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782607552.913054:0:8347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607552.913089:0:8347:0:(client.c:2701:ptlrpc_set_wait()) set ffff974578ff1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782607552.913193:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364356096 00000100:00100000:0.0:1782607552.913197:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364356096 00000100:00100000:0.0:1782607552.913223:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1782607552.913229:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974550829450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+15:8347:x1869199364356096:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782607552.913397:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974550829450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+15:8347:x1869199364356096:12345-0@lo:502:llog_process_th.0 Request processed in 167us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607552.913404:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1782607552.913600:0:8347:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567325880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:8347:1869199364356096:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782607552.913642:0:8347:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567325880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:8347:1869199364356224:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782607552.913675:0:8347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607552.913687:0:8347:0:(client.c:2701:ptlrpc_set_wait()) set ffff974578ff1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782607552.913737:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364356224 00000100:00100000:0.0:1782607552.913741:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364356224 00000100:00100000:0.0:1782607552.913781:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1782607552.913786:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+15:8347:x1869199364356224:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782607552.913884:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+15:8347:x1869199364356224:12345-0@lo:502:llog_process_th.0 Request processed in 96us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607552.913890:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1782607552.913964:0:8347:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567325880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:8347:1869199364356224:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1782607552.913984:0:8347:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1782607552.914421:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1782607552.914435:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782607552.914443:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9745585ac800/0x8109266df35cb141 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb148 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607552.914451:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff9745585ac800/0x8109266df35cb141 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb148 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782607552.914457:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1782607552.914459:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1782607552.914461:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1782607552.914482:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974540030800/0x8109266df35cb14f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607552.914487:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974540030800/0x8109266df35cb14f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607552.914502:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974540030800/0x8109266df35cb14f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607552.914513:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364356352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782607552.914540:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607552.914569:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff974578fe0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782607552.915575:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364356352 00000100:00100000:2.0:1782607552.915583:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364356352 00000100:00100000:2.0:1782607552.915633:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1782607552.915641:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974550828850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+15:5800:x1869199364356352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782607552.915654:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607552.915669:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9745585ad200/0x8109266df35cb156 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cb14f expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607552.915693:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9745585ad200/0x8109266df35cb156 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cb14f expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607552.915702:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9745585ad200/0x8109266df35cb156 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cb14f expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607552.915710:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585ad200, rc 0) 00000100:00100000:2.0:1782607552.915751:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974550828850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+16:5800:x1869199364356352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (1210us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607552.915757:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1782607552.915853:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364356352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782607552.915868:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974540030800/0x8109266df35cb14f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb156 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607552.915877:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974540030800/0x8109266df35cb14f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cb156 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607552.915931:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364356480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782607552.915960:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607552.915981:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff974578fe0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782607552.915995:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364356480 00000100:00100000:0.0:1782607552.915998:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364356480 00000100:00100000:0.0:1782607552.916016:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1782607552.916022:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+16:5800:x1869199364356480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782607552.916279:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+16:5800:x1869199364356480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 256us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607552.916286:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1782607552.916315:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364356480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782607552.916341:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364356608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782607552.916384:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607552.916397:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff974578fe0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782607552.916408:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364356608 00000100:00100000:0.0:1782607552.916411:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364356608 00000100:00100000:0.0:1782607552.916427:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1782607552.916433:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974550828450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+16:5800:x1869199364356608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782607552.916562:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974550828450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+16:5800:x1869199364356608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 128us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607552.916569:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1782607552.916604:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364356608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782607552.916799:0:8348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509ec000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:8348:1869199364356736:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782607552.916822:0:8348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607552.916835:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364356736 00000100:00100000:0.0:1782607552.916838:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364356736 00000100:00100000:0.0:1782607552.916852:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1782607552.916858:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+16:8348:x1869199364356736:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782607552.916977:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+16:8348:x1869199364356736:12345-0@lo:502:llog_process_th.0 Request processed in 120us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607552.916982:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1782607552.917004:0:8348:0:(client.c:2701:ptlrpc_set_wait()) set ffff974578fe0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782607552.917015:0:8348:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509ec000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:8348:1869199364356736:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782607552.917034:0:8348:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782607552.917042:0:8348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782607552.917044:0:8348:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1782607552.917051:0:8348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1782607552.917072:0:8348:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509ec000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:8348:1869199364356864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782607552.917105:0:8348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607552.917136:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364356864 00000100:00100000:0.0:1782607552.917139:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364356864 00000100:00100000:0.0:1782607552.917157:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1782607552.917162:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+16:8348:x1869199364356864:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782607552.917260:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+16:8348:x1869199364356864:12345-0@lo:502:llog_process_th.0 Request processed in 97us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607552.917267:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1782607552.917293:0:8348:0:(client.c:2701:ptlrpc_set_wait()) set ffff974578fe0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782607552.917305:0:8348:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509ec000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:8348:1869199364356864:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782607552.917322:0:8348:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782607552.917326:0:8348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782607552.917328:0:8348:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1782607552.917332:0:8348:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1782607552.917372:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1782607552.917383:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1782607552.917388:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974540030800/0x8109266df35cb14f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb156 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607552.917395:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974540030800/0x8109266df35cb14f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb156 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782607552.917402:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1782607552.917403:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff974544151000 from 39 10000000:01000000:0.0:1782607552.917405:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782607552.917420:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974540031e00/0x8109266df35cb15d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607552.917425:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974540031e00/0x8109266df35cb15d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607552.917439:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974540031e00/0x8109266df35cb15d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607552.917451:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364356992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782607552.917476:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607552.917489:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff974578fe0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782607552.917500:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364356992 00000100:00100000:0.0:1782607552.917503:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364356992 00000100:00100000:0.0:1782607552.917520:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1782607552.917525:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+16:5800:x1869199364356992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782607552.917532:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607552.917541:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974540031a00/0x8109266df35cb164 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cb15d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607552.917559:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974540031a00/0x8109266df35cb164 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cb15d expref: 17 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607552.917568:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974540031a00/0x8109266df35cb164 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cb15d expref: 17 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607552.917576:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974540031a00, rc 0) 00000100:00100000:0.0:1782607552.917602:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+17:5800:x1869199364356992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 76us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607552.917607:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1782607552.917633:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364356992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782607552.917642:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974540031e00/0x8109266df35cb15d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb164 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607552.917652:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974540031e00/0x8109266df35cb15d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cb164 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607552.917678:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364357120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782607552.917694:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607552.917703:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff974578fe0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782607552.917710:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364357120 00000100:00100000:0.0:1782607552.917712:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364357120 00000100:00100000:0.0:1782607552.917722:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1782607552.917725:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974550829c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+17:5800:x1869199364357120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782607552.917876:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974550829c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+17:5800:x1869199364357120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 148us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607552.917882:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1782607552.917908:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364357120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782607552.917930:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364357248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782607552.917962:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607552.917975:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff974578fe0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782607552.917986:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364357248 00000100:00100000:0.0:1782607552.917990:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364357248 00000100:00100000:0.0:1782607552.918005:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1782607552.918011:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+17:5800:x1869199364357248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782607552.918516:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+17:5800:x1869199364357248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 504us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607552.918524:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1782607552.918647:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364357248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782607552.919017:0:8349:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567325880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:8349:1869199364357376:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782607552.919044:0:8349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607552.919178:0:8349:0:(client.c:2701:ptlrpc_set_wait()) set ffff974578ff1180 going to sleep for 11 seconds 00000100:00100000:0.0:1782607552.919209:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364357376 00000100:00100000:0.0:1782607552.919214:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364357376 00000100:00100000:0.0:1782607552.919282:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1782607552.919290:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974550828c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+17:8349:x1869199364357376:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782607552.919460:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974550828c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+17:8349:x1869199364357376:12345-0@lo:502:llog_process_th.0 Request processed in 172us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607552.919465:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1782607552.919514:0:8349:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567325880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:8349:1869199364357376:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782607552.919550:0:8349:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567325880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:8349:1869199364357504:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782607552.919582:0:8349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607552.919646:0:8349:0:(client.c:2701:ptlrpc_set_wait()) set ffff974578fe0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782607552.919696:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364357504 00000100:00100000:3.0:1782607552.919699:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364357504 00000100:00100000:3.0:1782607552.919714:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1782607552.919718:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974550828050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+17:8349:x1869199364357504:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782607552.919836:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974550828050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+17:8349:x1869199364357504:12345-0@lo:502:llog_process_th.0 Request processed in 117us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607552.919840:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1782607552.919932:0:8349:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567325880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:8349:1869199364357504:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1782607552.919946:0:8349:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1782607552.920051:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1782607552.920067:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782607552.920084:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974540031e00/0x8109266df35cb15d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb164 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607552.920093:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974540031e00/0x8109266df35cb15d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb164 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782607552.920102:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1782607552.920104:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1782607552.920107:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1782607552.920242:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97455d648800/0x8109266df35cb16b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607552.920248:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff97455d648800/0x8109266df35cb16b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607552.920254:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff97455d648800/0x8109266df35cb16b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607552.920262:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974551140e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364357632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782607552.920280:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607552.920301:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff974551670000 going to sleep for 11 seconds 00000100:00100000:2.0:1782607552.920337:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364357632 00000100:00100000:2.0:1782607552.920339:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364357632 00000100:00100000:2.0:1782607552.920353:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1782607552.920356:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+17:5800:x1869199364357632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782607552.920362:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607552.920370:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9745585ad800/0x8109266df35cb172 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cb16b expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607552.920383:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9745585ad800/0x8109266df35cb172 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cb16b expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607552.920389:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9745585ad800/0x8109266df35cb172 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cb16b expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607552.920395:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585ad800, rc 0) 00000100:00100000:2.0:1782607552.920422:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+18:5800:x1869199364357632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 65us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607552.920426:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1782607552.920474:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974551140e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364357632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782607552.920484:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff97455d648800/0x8109266df35cb16b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb172 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607552.920492:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff97455d648800/0x8109266df35cb16b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cb172 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607552.920543:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974551140e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364357760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782607552.920565:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607552.920584:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff974551670000 going to sleep for 11 seconds 00000100:00100000:2.0:1782607552.920631:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364357760 00000100:00100000:2.0:1782607552.920635:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364357760 00000100:00100000:2.0:1782607552.920652:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1782607552.920657:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+18:5800:x1869199364357760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782607552.920963:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+18:5800:x1869199364357760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 304us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607552.920975:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1782607552.921205:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974551140e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364357760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782607552.921231:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974551140e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364357888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782607552.921265:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607552.921324:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff974551670000 going to sleep for 11 seconds 00000100:00100000:1.0:1782607552.921358:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364357888 00000100:00100000:1.0:1782607552.921362:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364357888 00000100:00100000:2.0:1782607552.921404:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1782607552.921411:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+18:5800:x1869199364357888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782607552.921549:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+18:5800:x1869199364357888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607552.921555:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1782607552.921637:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974551140e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364357888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782607552.922005:0:8350:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974551140e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:8350:1869199364358016:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782607552.922038:0:8350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607552.922065:0:8350:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745511a4480 going to sleep for 11 seconds 00000100:00100000:0.0:1782607552.922179:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364358016 00000100:00100000:0.0:1782607552.922184:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364358016 00000100:00100000:0.0:1782607552.922212:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1782607552.922219:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+18:8350:x1869199364358016:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782607552.922391:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+18:8350:x1869199364358016:12345-0@lo:502:llog_process_th.0 Request processed in 172us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607552.922399:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1782607552.922480:0:8350:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974551140e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:8350:1869199364358016:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782607552.922505:0:8350:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782607552.922514:0:8350:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782607552.922516:0:8350:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1782607552.922523:0:8350:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1782607552.922545:0:8350:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974551140e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:8350:1869199364358144:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782607552.922576:0:8350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607552.922598:0:8350:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745511a4480 going to sleep for 11 seconds 00000100:00100000:0.0:1782607552.922646:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364358144 00000100:00100000:0.0:1782607552.922650:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364358144 00000100:00100000:0.0:1782607552.922667:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1782607552.922673:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+18:8350:x1869199364358144:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782607552.922817:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+18:8350:x1869199364358144:12345-0@lo:502:llog_process_th.0 Request processed in 143us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607552.922824:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1782607552.922897:0:8350:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974551140e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:8350:1869199364358144:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782607552.922915:0:8350:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782607552.922919:0:8350:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782607552.922921:0:8350:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1782607552.922929:0:8350:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1782607552.923705:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1782607552.923727:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1782607552.923736:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97455d648800/0x8109266df35cb16b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb172 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607552.923747:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff97455d648800/0x8109266df35cb16b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb172 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782607552.923795:0:5800:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1782607552.923797:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff974549e68000 from 1 10000000:01000000:0.0:1782607552.923800:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1782607552.923829:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974540030e00/0x8109266df35cb179 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607552.923837:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974540030e00/0x8109266df35cb179 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607552.923845:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974540030e00/0x8109266df35cb179 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607552.923863:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364358272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782607552.923903:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607552.923933:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745712a9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782607552.924016:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364358272 00000100:00100000:2.0:1782607552.924021:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364358272 00000100:00100000:2.0:1782607552.924060:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1782607552.924301:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+18:5800:x1869199364358272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782607552.924315:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607552.924327:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9745585ac200/0x8109266df35cb180 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cb179 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607552.924348:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9745585ac200/0x8109266df35cb180 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cb179 expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607552.924359:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9745585ac200/0x8109266df35cb180 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cb179 expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607552.924367:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585ac200, rc 0) 00000100:00100000:2.0:1782607552.924411:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+19:5800:x1869199364358272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 345us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607552.924418:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1782607552.924489:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364358272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782607552.924502:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974540030e00/0x8109266df35cb179 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb180 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607552.924511:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974540030e00/0x8109266df35cb179 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cb180 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607552.924636:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364358400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782607552.924662:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607552.924717:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745712a9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782607552.924806:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364358400 00000100:00100000:1.0:1782607552.924811:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364358400 00000100:00100000:1.0:1782607552.924831:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1782607552.924838:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+19:5800:x1869199364358400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782607552.925061:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+19:5800:x1869199364358400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 223us (397us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782607552.925068:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1782607552.925238:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364358400:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1782607552.925264:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1782607552.925278:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974540030e00/0x8109266df35cb179 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb180 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607552.925286:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974540030e00/0x8109266df35cb179 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb180 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607553.730089:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782607554.114274:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974548949f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1869199364358784:0@lo:400:kworker.0 00000100:00100000:3.0:1782607554.114346:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607554.114416:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782607554.114422:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97454894bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364358912:0@lo:400:kworker.0 00000100:00100000:3.0:1782607554.114447:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607554.114541:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974548949c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869199364358656:0@lo:400:kworker.0 00000100:00100000:2.0:1782607554.114569:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607554.114621:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97454894ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364359168:0@lo:400:kworker.0 00000100:00100000:2.0:1782607554.114642:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607554.114661:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1782607554.114666:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97454894a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fae11c6e-4506-4104-bb8c-df42498f7e08:3317:1869199364358528:0@lo:400:kworker.0 00000100:00100000:2.0:1782607554.114691:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607554.114707:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974548949500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3317:1869199364359040:0@lo:400:kworker.0 00000100:00100000:2.0:1782607554.114724:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607554.114749:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364358784 00000100:00100000:2.0:1782607554.114755:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364358784 00000100:00100000:2.0:1782607554.114817:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364358656 00000100:00100000:2.0:1782607554.114820:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364358656 00000100:00100000:2.0:1782607554.114831:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364359040 00000100:00100000:2.0:1782607554.114833:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364359040 00000100:00100000:2.0:1782607554.114847:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782607554.114854:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974551140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1869199364358784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607554.115118:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782607554.115127:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974567325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869199364358656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607554.115181:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974567325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869199364358656:12345-0@lo:400:kworker.0 Request processed in 55us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607554.115188:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782607554.115206:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782607554.115212:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974567327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869199364359040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607554.115234:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974567327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869199364359040:12345-0@lo:400:kworker.0 Request processed in 23us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607554.115239:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782607554.115256:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364358912 00000100:00100000:3.0:1782607554.115259:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364358912 00000100:00100000:3.0:1782607554.115284:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364359168 00000100:00100000:3.0:1782607554.115287:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364359168 00000100:00100000:3.0:1782607554.115302:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782607554.115308:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974551140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364358912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607554.115338:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974551140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364358912:12345-0@lo:400:kworker.0 Request processed in 31us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607554.115344:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782607554.115354:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782607554.115367:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974567326a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364359168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607554.115393:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974567326a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364359168:12345-0@lo:400:kworker.0 Request processed in 27us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607554.115398:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782607554.115431:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974548949500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3317:1869199364359040:0@lo:400:kworker.0 00000100:00100000:3.0:1782607554.115441:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974548949c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869199364358656:0@lo:400:kworker.0 00010000:00080000:3.0:1782607554.115452:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97454894ad80 x1869199364359168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607554.115461:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97454894ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364359168:0@lo:400:kworker.0 00010000:00080000:3.0:1782607554.115490:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97454894bb80 x1869199364358912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607554.115498:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97454894bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364358912:0@lo:400:kworker.0 00000100:00080000:3.0:1782607554.115521:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782607554.115537:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782607554.115540:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782607554.115696:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974551140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1869199364358784:12345-0@lo:400:kworker.0 Request processed in 842us (1350us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607554.115702:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782607554.115851:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974548949f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1869199364358784:0@lo:400:kworker.0 00000100:00100000:1.0:1782607554.115975:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364358528 00000100:00100000:1.0:1782607554.115979:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364358528 00000100:00100000:1.0:1782607554.116021:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1782607554.116029:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3317:x1869199364358528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607554.116069:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3317:x1869199364358528:12345-0@lo:400:kworker.0 Request processed in 41us (1377us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607554.116076:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1782607554.116207:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97454894a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fae11c6e-4506-4104-bb8c-df42498f7e08:3317:1869199364358528:0@lo:400:kworker.0 00000100:00100000:1.0:1782607554.626160:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782607554.626183:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364359296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782607554.626265:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607554.626412:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364359296 00000100:00100000:2.0:1782607554.626421:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364359296 00000100:00100000:2.0:1782607554.626483:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782607554.626495:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97454894b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364359296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782607554.626532:0:6612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782607554.626586:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97454894b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364359296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607554.626594:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1782607554.626817:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9745509ed180 x1869199364359296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607570 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782607554.626834:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364359296:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782607554.753994:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782607554.924913:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607554.925022:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342310272 00000100:00100000:2.0:1782607554.925046:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342310272 00000100:00100000:2.0:1782607554.925113:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 165 00000100:00100000:2.0:1782607554.925123:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+8:5571:x1869199342310272:12345-192.168.202.4@tcp:101: 00010000:00010000:2.0:1782607554.925141:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607554.925160:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9745585ac000/0x8109266df35cb187 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffbec expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607554.925192:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9745585ac000/0x8109266df35cb187 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffbec expref: 9 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607554.925203:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9745585ac000/0x8109266df35cb187 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffbec expref: 9 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607554.925213:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585ac000, rc 0) 00000100:00100000:2.0:1782607554.925287:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+9:5571:x1869199342310272:12345-192.168.202.4@tcp:101: Request processed in 166us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607554.925294:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 165 00000100:00100000:1.0:1782607554.935087:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607554.935751:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342310400 00000100:00100000:2.0:1782607554.935762:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342310400 00000100:00100000:2.0:1782607554.935863:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 166 00000100:00100000:2.0:1782607554.935873:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+9:5571:x1869199342310400:12345-192.168.202.4@tcp:501: 00000100:00100000:2.0:1782607554.936178:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+9:5571:x1869199342310400:12345-192.168.202.4@tcp:501: Request processed in 305us (1102us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607554.936186:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 166 00000100:00100000:3.0:1782607554.938431:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607554.938567:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342310528 00000100:00100000:1.0:1782607554.938575:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342310528 00000100:00100000:1.0:1782607554.938629:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 167 00000100:00100000:1.0:1782607554.938639:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+9:5571:x1869199342310528:12345-192.168.202.4@tcp:503: 00000100:00100000:1.0:1782607554.938914:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+9:5571:x1869199342310528:12345-192.168.202.4@tcp:503: Request processed in 276us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607554.938922:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 167 00000100:00100000:1.0:1782607554.944643:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607554.944733:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342310656 00000100:00100000:0.0:1782607554.944743:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342310656 00000100:00100000:0.0:1782607554.944820:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 168 00000100:00100000:0.0:1782607554.944829:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+9:6058:x1869199342310656:12345-192.168.202.4@tcp:502: 00000100:00100000:0.0:1782607554.945103:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+9:6058:x1869199342310656:12345-192.168.202.4@tcp:502: Request processed in 265us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607554.945112:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 168 00000100:00100000:0.0:1782607554.951969:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607554.952068:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342310784 00000100:00100000:2.0:1782607554.952077:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342310784 00000100:00100000:2.0:1782607554.952142:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 169 00000100:00100000:2.0:1782607554.952152:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+9:6058:x1869199342310784:12345-192.168.202.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782607554.952544:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+9:6058:x1869199342310784:12345-192.168.202.4@tcp:502:llog_process_th.0 Request processed in 392us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607554.952552:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 169 00000100:00100000:3.0:1782607554.959693:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607554.959948:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342310912 00000100:00100000:1.0:1782607554.959958:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342310912 00000100:00100000:1.0:1782607554.960020:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 170 00000100:00100000:1.0:1782607554.960030:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+9:5571:x1869199342310912:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782607554.960046:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607554.960063:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9745821d1400/0x8109266df35cb18e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffbf3 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607554.960091:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9745821d1400/0x8109266df35cb18e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffbf3 expref: 10 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607554.960113:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9745821d1400/0x8109266df35cb18e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffbf3 expref: 10 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607554.960122:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745821d1400, rc 0) 00000100:00100000:1.0:1782607554.960179:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+10:5571:x1869199342310912:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 149us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607554.960186:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 170 00000100:00100000:1.0:1782607554.967900:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607554.968009:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342311040 00000100:00100000:0.0:1782607554.968020:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342311040 00000100:00100000:0.0:1782607554.968076:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 171 00000100:00100000:0.0:1782607554.968086:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+10:5571:x1869199342311040:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782607554.968549:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+10:5571:x1869199342311040:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 Request processed in 463us (657us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782607554.968557:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 171 00000100:00100000:3.0:1782607555.655305:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364359424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782607555.655377:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607555.655456:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364359424 00000100:00100000:3.0:1782607555.655477:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364359424 00000100:00100000:3.0:1782607555.655527:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782607555.655535:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974551140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364359424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782607555.655590:0:6612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782607555.655637:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974551140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364359424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607555.655645:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1782607555.655705:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974567326300 x1869199364359424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607571 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607555.655726:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364359424:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782607555.779880:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782607556.464360:0:8388:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff838d9960 20000000:00000080:3.0:1782607556.464379:0:8388:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97457776f800 uarg=0000000000000000 20000000:01000000:3.0:1782607556.464494:0:8388:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1782607556.464500:0:8388:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1782607556.464506:0:8388:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1782607556.465626:0:8389:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1782607556.465825:0:8388:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1782607556.470732:0:8388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1782607556.471093:0:8388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1782607556.471164:0:8388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1782607556.471180:0:8388:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1782607556.471200:0:8388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9745585ace00/0x8109266df35cb195 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607556.471218:0:8388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff974582050200/0x8109266df35caf0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35caf03 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607556.471225:0:8388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9745821d1200/0x8109266df35caf6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35caf65 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607556.471232:0:8388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff974540030000/0x8109266df35cb037 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cb030 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607556.471240:0:8388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9745585ad600/0x8109266df35cb0f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffbbb expref: 9 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607556.471247:0:8388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9745585ace00/0x8109266df35cb195 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607556.471285:0:8388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9745585ad600/0x8109266df35cb0f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffbbb expref: 9 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607556.471300:0:8388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9745585ad600/0x8109266df35cb0f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffbbb expref: 9 pid: 5798 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607556.471329:0:8388:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567325c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8388:1869199364359552:192.168.202.4@tcp:104: 00010000:00010000:2.0:1782607556.471553:0:8388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff974540030000/0x8109266df35cb037 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8109266df35cb030 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607556.471561:0:8388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff974540030000/0x8109266df35cb037 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8109266df35cb030 expref: 18 pid: 5798 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607556.471569:0:8388:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567325f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8388:1869199364359680:0@lo:104: 00000100:00100000:2.0:1782607556.471609:0:8388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782607556.471653:0:8388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9745821d1200/0x8109266df35caf6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8109266df35caf65 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607556.471661:0:8388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9745821d1200/0x8109266df35caf6c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8109266df35caf65 expref: 18 pid: 5798 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607556.471669:0:8388:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567325500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8388:1869199364359808:0@lo:104: 00000100:00100000:2.0:1782607556.471690:0:8388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782607556.471718:0:8388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff974582050200/0x8109266df35caf0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8109266df35caf03 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607556.471726:0:8388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff974582050200/0x8109266df35caf0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8109266df35caf03 expref: 18 pid: 5797 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607556.471735:0:8388:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567326d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8388:1869199364359936:0@lo:104: 00000100:00100000:2.0:1782607556.471752:0:8388:0:(client.c:2701:ptlrpc_set_wait()) set ffff97457f834180 going to sleep for 11 seconds 00000100:00100000:3.0:1782607556.472106:0:5785:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1782607556.472124:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607556.472135:0:5785:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364359680 00000100:00100000:3.0:1782607556.472141:0:5785:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364359680 00000100:00100000:3.0:1782607556.472175:0:5785:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364359808 00000100:00100000:3.0:1782607556.472177:0:5785:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364359808 00000100:00100000:3.0:1782607556.472186:0:5785:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364359936 00000100:00100000:3.0:1782607556.472187:0:5785:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364359936 00000100:00100000:3.0:1782607556.472198:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782607556.472206:0:5785:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974567327b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+5:8388:x1869199364359680:12345-0@lo:104: 00010000:00010000:3.0:1782607556.472217:0:5785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff9745585acc00/0x8109266df35cb030 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cb037 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607556.472323:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782607556.472329:0:5785:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974567327b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+5:8388:x1869199364359680:12345-0@lo:104: Request processed in 125us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607556.472337:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782607556.472355:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782607556.472360:0:5785:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f463c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+4:8388:x1869199364359808:12345-0@lo:104: 00010000:00010000:3.0:1782607556.472368:0:5785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff974582051c00/0x8109266df35caf65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35caf6c expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607556.472409:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782607556.472415:0:5785:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f463c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+4:8388:x1869199364359808:12345-0@lo:104: Request processed in 55us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607556.472420:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782607556.472455:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782607556.472462:0:5785:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974551140a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+3:8388:x1869199364359936:12345-0@lo:104: 00010000:00010000:3.0:1782607556.472468:0:5785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff9745821d0400/0x8109266df35caf03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35caf0a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607556.472498:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1782607556.472503:0:5785:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974551140a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+3:8388:x1869199364359936:12345-0@lo:104: Request processed in 43us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607556.472508:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1782607556.472523:0:7513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1782607556.472528:0:7513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff9745585acc00/0x8109266df35cb030 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cb037 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607556.472536:0:7513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585acc00 already unused, calling callback (ffffffffc1db0c20) 10000000:00010000:3.0:1782607556.472545:0:7513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff9745585acc00/0x8109266df35cb030 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8109266df35cb037 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607556.472554:0:7513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff9745585acc00/0x8109266df35cb030 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8109266df35cb037 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782607556.472561:0:7513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff9745585acc00/0x8109266df35cb030 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8109266df35cb037 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782607556.472566:0:7513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782607556.472595:0:7513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff9745585acc00/0x8109266df35cb030 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cb037 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607556.472601:0:7513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782607556.472619:0:7513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff9745585acc00/0x8109266df35cb030 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cb037 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607556.472626:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff9745585acc00/0x8109266df35cb030 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cb037 expref: -99 pid: 7507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607556.472649:0:7513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782607556.472653:0:7513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974582051c00/0x8109266df35caf65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35caf6c expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607556.472659:0:7513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974582051c00 already unused, calling callback (ffffffffc1db0c20) 10000000:00010000:3.0:1782607556.472662:0:7513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974582051c00/0x8109266df35caf65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8109266df35caf6c expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607556.472668:0:7513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974582051c00/0x8109266df35caf65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8109266df35caf6c expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782607556.472683:0:7513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974582051c00/0x8109266df35caf65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8109266df35caf6c expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782607556.472688:0:7513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782607556.472702:0:7513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974582051c00/0x8109266df35caf65 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35caf6c expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607556.472708:0:7513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782607556.472714:0:7513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974582051c00/0x8109266df35caf65 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35caf6c expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607556.472720:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974582051c00/0x8109266df35caf65 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35caf6c expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607556.472732:0:7513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782607556.472735:0:7513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff9745821d0400/0x8109266df35caf03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35caf0a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607556.472741:0:7513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745821d0400 already unused, calling callback (ffffffffc1db0c20) 10000000:00010000:3.0:1782607556.472744:0:7513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff9745821d0400/0x8109266df35caf03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8109266df35caf0a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607556.472750:0:7513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff9745821d0400/0x8109266df35caf03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8109266df35caf0a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782607556.472757:0:7513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff9745821d0400/0x8109266df35caf03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8109266df35caf0a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782607556.472762:0:7513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782607556.472809:0:7513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff9745821d0400/0x8109266df35caf03 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35caf0a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607556.472815:0:7513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782607556.472828:0:7513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff9745821d0400/0x8109266df35caf03 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35caf0a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607556.472835:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff9745821d0400/0x8109266df35caf03 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35caf0a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607556.472863:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607556.472865:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607556.472867:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607556.472874:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607556.472879:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782607556.472890:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974551140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fae11c6e-4506-4104-bb8c-df42498f7e08:3316:1869199364360064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782607556.472917:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607556.472957:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782607556.472963:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974551141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fae11c6e-4506-4104-bb8c-df42498f7e08:3316:1869199364360192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782607556.473222:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607556.473291:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974551142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fae11c6e-4506-4104-bb8c-df42498f7e08:3318:1869199364360320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782607556.473314:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607556.473437:0:8388:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567325f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8388:1869199364359680:0@lo:104: 00000100:00100000:2.0:1782607556.473446:0:8388:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567325500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8388:1869199364359808:0@lo:104: 00000100:00100000:2.0:1782607556.473461:0:8388:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567326d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8388:1869199364359936:0@lo:104: 00000100:00100000:1.0:1782607556.474361:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364360064 00000100:00100000:1.0:1782607556.474369:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364360064 00010000:00010000:1.0:1782607556.474411:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff974540030000/0x8109266df35cb037 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cb030 expref: 19 pid: 5798 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607556.474466:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364360192 00000100:00100000:2.0:1782607556.474470:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364360192 00010000:00010000:2.0:1782607556.474485:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9745821d1200/0x8109266df35caf6c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35caf65 expref: 20 pid: 5798 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607556.474497:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364360320 00000100:00100000:2.0:1782607556.474500:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364360320 00010000:00010000:2.0:1782607556.474511:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff974582050200/0x8109266df35caf0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35caf03 expref: 21 pid: 5797 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607556.474524:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782607556.474530:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974551141880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fae11c6e-4506-4104-bb8c-df42498f7e08+21:3316:x1869199364360064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782607556.474543:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782607556.474548:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff974540030000/0x8109266df35cb037 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cb030 expref: 21 pid: 5798 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607556.474557:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff974540030000/0x8109266df35cb037 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8109266df35cb030 expref: 21 pid: 5798 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607556.474573:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974540030000/0x8109266df35cb037 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8109266df35cb030 expref: 21 pid: 5798 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607556.474586:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782607556.474802:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974551141880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fae11c6e-4506-4104-bb8c-df42498f7e08+20:3316:x1869199364360064:12345-0@lo:103:ldlm_bl.0 Request processed in 271us (1883us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607556.474809:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782607556.474824:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782607556.474830:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974551142a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3316:x1869199364360192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782607556.474846:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782607556.474860:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9745821d1200/0x8109266df35caf6c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35caf65 expref: 19 pid: 5798 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607556.474869:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9745821d1200/0x8109266df35caf6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8109266df35caf65 expref: 19 pid: 5798 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607556.474878:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9745821d1200/0x8109266df35caf6c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8109266df35caf65 expref: 19 pid: 5798 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607556.474887:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782607556.474908:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974551142a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fae11c6e-4506-4104-bb8c-df42498f7e08+18:3316:x1869199364360192:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (1686us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607556.474914:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782607556.474925:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782607556.474930:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974551143100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fae11c6e-4506-4104-bb8c-df42498f7e08+17:3318:x1869199364360320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782607556.474949:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782607556.474953:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff974582050200/0x8109266df35caf0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35caf03 expref: 17 pid: 5797 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607556.474960:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff974582050200/0x8109266df35caf0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8109266df35caf03 expref: 17 pid: 5797 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607556.475069:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974582050200/0x8109266df35caf0a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8109266df35caf03 expref: 17 pid: 5797 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607556.475078:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782607556.475116:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974551143100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fae11c6e-4506-4104-bb8c-df42498f7e08+16:3318:x1869199364360320:12345-0@lo:103:ldlm_bl.0 Request processed in 185us (1801us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607556.475130:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782607556.475351:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974551142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fae11c6e-4506-4104-bb8c-df42498f7e08:3318:1869199364360320:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782607556.475622:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974551140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fae11c6e-4506-4104-bb8c-df42498f7e08:3316:1869199364360064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782607556.475637:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974551141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fae11c6e-4506-4104-bb8c-df42498f7e08:3316:1869199364360192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782607556.479835:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607556.480031:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342311168 00000100:00100000:3.0:1782607556.480042:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342311168 00010000:00010000:3.0:1782607556.480081:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9745585ad600/0x8109266df35cb0f4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffbbb expref: 10 pid: 5798 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607556.480137:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 24 00000100:00100000:3.0:1782607556.480162:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97454894b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+10:2357:x1869199342311168:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782607556.480176:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782607556.480181:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9745585ad600/0x8109266df35cb0f4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffbbb expref: 10 pid: 5798 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607556.480194:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9745585ad600/0x8109266df35cb0f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffbbb expref: 10 pid: 5798 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607556.480216:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9745585ace00/0x8109266df35cb195 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607556.480224:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9745585ace00/0x8109266df35cb195 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607556.480239:0:5788:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9745585ace00/0x8109266df35cb195 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607556.480245:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9745585ace00/0x8109266df35cb195 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607556.480251:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9745585ace00/0x8109266df35cb195 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607556.480257:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9745585ace00/0x8109266df35cb195 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607556.480262:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ace00 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:3.0:1782607556.480266:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9745585ace00/0x8109266df35cb195 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607556.480273:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9745585ace00/0x8109266df35cb195 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607556.480286:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9745585ace00/0x8109266df35cb195 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607556.480308:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782607556.480457:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9745585ad600/0x8109266df35cb0f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffbbb expref: 10 pid: 5798 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607556.480471:0:8388:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567325c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8388:1869199364359552:192.168.202.4@tcp:104: 00010000:00010000:2.0:1782607556.480495:0:8388:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9745585ace00/0x8109266df35cb195 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607556.480504:0:8388:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9745585ace00/0x8109266df35cb195 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607556.480510:0:8388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9745585ace00/0x8109266df35cb195 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607556.480515:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9745585ace00/0x8109266df35cb195 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607556.495895:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97454894b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+9:2357:x1869199342311168:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 15718us (16056us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607556.495912:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 24 00010000:00010000:3.0:1782607556.801995:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782607556.842602:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607556.842640:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607556.842674:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607556.842795:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342311296 00000100:00100000:3.0:1782607556.842804:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342311296 00000100:00100000:3.0:1782607556.842878:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 33 00000100:00100000:3.0:1782607556.842889:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745509ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2355:x1869199342311296:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1782607556.842979:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745509ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2355:x1869199342311296:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 91us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607556.842985:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 33 00000100:00100000:1.0:1782607556.843115:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342311552 00000100:00100000:1.0:1782607556.843120:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342311552 00000100:00100000:1.0:1782607556.843168:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342311424 00000100:00100000:1.0:1782607556.843171:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342311424 00000100:00100000:1.0:1782607556.843191:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 18 00000100:00100000:1.0:1782607556.843199:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745509ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2355:x1869199342311552:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1782607556.843229:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745509ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2355:x1869199342311552:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 31us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607556.843235:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 18 00000100:00100000:1.0:1782607556.843247:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 19 00000100:00100000:1.0:1782607556.843252:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745509ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2355:x1869199342311424:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1782607556.843277:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745509ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2355:x1869199342311424:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 25us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607556.843283:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 19 00000100:00080000:0.0:1782607556.843653:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782607556.843657:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782607556.843659:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782607556.969660:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607556.969845:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342311680 00000100:00100000:0.0:1782607556.969855:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342311680 00000100:00100000:0.0:1782607556.969914:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 172 00000100:00100000:0.0:1782607556.969924:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+9:5571:x1869199342311680:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782607556.969940:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607556.969960:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974546c42800/0x8109266df35cb19c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffbfa expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607556.969988:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974546c42800/0x8109266df35cb19c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffbfa expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607556.969998:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974546c42800/0x8109266df35cb19c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffbfa expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607556.970006:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c42800, rc 0) 00000100:00100000:0.0:1782607556.970070:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+10:5571:x1869199342311680:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 148us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607556.970077:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 172 00000100:00100000:1.0:1782607556.978545:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607556.979188:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342311808 00000100:00100000:0.0:1782607556.979198:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342311808 00000100:00100000:0.0:1782607556.979264:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 173 00000100:00100000:0.0:1782607556.979274:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+10:5571:x1869199342311808:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782607556.979579:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+10:5571:x1869199342311808:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 Request processed in 305us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607556.979588:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 173 00000100:00100000:2.0:1782607556.983206:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607556.983290:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342311936 00000100:00100000:1.0:1782607556.983300:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342311936 00000100:00100000:1.0:1782607556.983442:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 174 00000100:00100000:1.0:1782607556.983454:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+10:5571:x1869199342311936:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782607556.983709:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+10:5571:x1869199342311936:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 Request processed in 256us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607556.983718:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 174 00000100:00100000:2.0:1782607556.994351:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607556.994684:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342312064 00000100:00100000:0.0:1782607556.994695:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342312064 00000100:00100000:0.0:1782607556.994755:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 175 00000100:00100000:0.0:1782607556.994781:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+10:6115:x1869199342312064:12345-192.168.202.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782607556.997070:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+10:6115:x1869199342312064:12345-192.168.202.4@tcp:502:llog_process_th.0 Request processed in 2296us (2719us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607556.997094:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 175 00000100:00100000:3.0:1782607557.010209:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607557.010841:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342312192 00000100:00100000:1.0:1782607557.010864:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342312192 00000100:00100000:1.0:1782607557.010922:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 176 00000100:00100000:1.0:1782607557.010931:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+10:6115:x1869199342312192:12345-192.168.202.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782607557.011275:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+10:6115:x1869199342312192:12345-192.168.202.4@tcp:502:llog_process_th.0 Request processed in 344us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607557.011283:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 176 00010000:00010000:3.0:1782607557.838644:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782607558.273872:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782607558.273881:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff97457f5e0000 from 4 10000000:01000000:0.0:1782607558.273887:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782607558.273941:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974546c42e00/0x8109266df35cb1a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607558.274671:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974546c42e00/0x8109266df35cb1a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607558.274684:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974546c42e00/0x8109266df35cb1a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607558.274715:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364360448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782607558.274867:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607558.274919:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745712a9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782607558.275205:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364360448 00000100:00100000:1.0:1782607558.275212:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364360448 00000100:00100000:1.0:1782607558.275329:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1782607558.275339:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+16:5800:x1869199364360448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782607558.275354:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607558.275369:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9745821d1200/0x8109266df35cb1aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cb1a3 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607558.275395:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9745821d1200/0x8109266df35cb1aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cb1a3 expref: 17 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607558.275406:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9745821d1200/0x8109266df35cb1aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cb1a3 expref: 17 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607558.275414:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745821d1200, rc 0) 00000100:00100000:1.0:1782607558.275463:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+17:5800:x1869199364360448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607558.275470:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1782607558.275557:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364360448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782607558.275573:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974546c42e00/0x8109266df35cb1a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb1aa expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607558.275595:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974546c42e00/0x8109266df35cb1a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cb1aa expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607558.275652:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364360576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782607558.275677:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607558.277454:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745712a9d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782607558.277594:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364360576 00000100:00100000:3.0:1782607558.277602:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364360576 00000100:00100000:3.0:1782607558.277652:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1782607558.277662:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+17:5800:x1869199364360576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782607558.278434:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+17:5800:x1869199364360576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 772us (2753us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607558.278443:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1782607558.278746:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364360576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782607558.279104:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364360704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782607558.279158:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607558.279251:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364360704 00000100:00100000:1.0:1782607558.279258:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364360704 00000100:00100000:1.0:1782607558.279300:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1782607558.279307:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+17:5800:x1869199364360704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782607558.279622:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745712a9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782607558.279747:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+17:5800:x1869199364360704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 440us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607558.279755:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1782607558.280151:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364360704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782607558.282737:0:8456:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974551142680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:8456:1869199364360832:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782607558.282841:0:8456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607558.282886:0:8456:0:(client.c:2701:ptlrpc_set_wait()) set ffff974543959900 going to sleep for 11 seconds 00000100:00100000:2.0:1782607558.283198:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364360832 00000100:00100000:2.0:1782607558.283205:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364360832 00000100:00100000:2.0:1782607558.283257:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1782607558.283267:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+17:8456:x1869199364360832:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782607558.283477:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+17:8456:x1869199364360832:12345-0@lo:502:llog_process_th.0 Request processed in 211us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607558.283603:0:8456:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974551142680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:8456:1869199364360832:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782607558.283633:0:8456:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782607558.283642:0:8456:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782607558.283645:0:8456:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1782607558.283651:0:8456:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff97457f5e0000 00000020:00000080:3.0:1782607558.283653:0:8456:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1782607558.283741:0:8456:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974551142680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:8456:1869199364360960:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782607558.283798:0:8456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607558.283818:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364360960 00000100:00100000:3.0:1782607558.283822:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364360960 00000100:00100000:3.0:1782607558.283845:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1782607558.283851:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+18:8456:x1869199364360960:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782607558.284147:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+18:8456:x1869199364360960:12345-0@lo:502:llog_process_th.0 Request processed in 295us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607558.284155:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1782607558.284189:0:8456:0:(client.c:2701:ptlrpc_set_wait()) set ffff97454733c600 going to sleep for 11 seconds 00000100:00100000:3.0:1782607558.284202:0:8456:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974551142680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:8456:1869199364360960:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782607558.284219:0:8456:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782607558.284223:0:8456:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782607558.284225:0:8456:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1782607558.284228:0:8456:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000100:00100000:2.0:1782607558.285096:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000020:01000000:2.0:1782607558.285143:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1782607558.285168:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782607558.285179:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974546c42e00/0x8109266df35cb1a3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb1aa expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607558.285192:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974546c42e00/0x8109266df35cb1a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb1aa expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782607558.285202:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782607558.285205:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff97455053f000 from 4 10000000:01000000:2.0:1782607558.285208:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782607558.285307:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9745585ad400/0x8109266df35cb1b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607558.285316:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff9745585ad400/0x8109266df35cb1b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607558.285325:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff9745585ad400/0x8109266df35cb1b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607558.285343:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567325c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364361088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782607558.285383:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607558.285405:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff97457f834a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782607558.285422:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364361088 00000100:00100000:2.0:1782607558.285427:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364361088 00000100:00100000:2.0:1782607558.285454:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1782607558.285462:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+17:5800:x1869199364361088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782607558.285471:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607558.286105:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9745585ad000/0x8109266df35cb1b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cb1b1 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607558.286147:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9745585ad000/0x8109266df35cb1b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cb1b1 expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607558.286157:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9745585ad000/0x8109266df35cb1b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cb1b1 expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607558.286167:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585ad000, rc 0) 00000100:00100000:2.0:1782607558.286216:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+18:5800:x1869199364361088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 754us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607558.286222:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1782607558.286292:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567325c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364361088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782607558.286317:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff9745585ad400/0x8109266df35cb1b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb1b8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607558.286327:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff9745585ad400/0x8109266df35cb1b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cb1b8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607558.286382:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364361216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782607558.286408:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607558.286431:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745712a9840 going to sleep for 11 seconds 00000100:00100000:0.0:1782607558.286445:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364361216 00000100:00100000:0.0:1782607558.286448:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364361216 00000100:00100000:0.0:1782607558.286466:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1782607558.286479:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+18:5800:x1869199364361216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782607558.286719:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+18:5800:x1869199364361216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 240us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607558.286726:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1782607558.286757:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364361216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782607558.286817:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364361344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782607558.286850:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607558.286875:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745712a9840 going to sleep for 11 seconds 00000100:00100000:0.0:1782607558.286887:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364361344 00000100:00100000:0.0:1782607558.286890:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364361344 00000100:00100000:0.0:1782607558.286907:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1782607558.286912:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+18:5800:x1869199364361344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782607558.287065:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+18:5800:x1869199364361344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607558.287082:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1782607558.287120:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364361344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782607558.288347:0:8458:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509eea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:8458:1869199364361472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782607558.288408:0:8458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607558.288439:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364361472 00000100:00100000:0.0:1782607558.288444:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364361472 00000100:00100000:0.0:1782607558.288485:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1782607558.288561:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+18:8458:x1869199364361472:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782607558.288727:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+18:8458:x1869199364361472:12345-0@lo:502:llog_process_th.0 Request processed in 168us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607558.288744:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1782607558.289058:0:8458:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745712a9780 going to sleep for 11 seconds 00000100:00100000:0.0:1782607558.289089:0:8458:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509eea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:8458:1869199364361472:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782607558.289117:0:8458:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782607558.289127:0:8458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782607558.289129:0:8458:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1782607558.289136:0:8458:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff97455053f000 00000020:00000080:0.0:1782607558.289138:0:8458:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1782607558.295060:0:8458:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97454894a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:8458:1869199364361600:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782607558.295172:0:8458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607558.295344:0:8458:0:(client.c:2701:ptlrpc_set_wait()) set ffff97457f923240 going to sleep for 11 seconds 00000100:00100000:2.0:1782607558.298104:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364361600 00000100:00100000:2.0:1782607558.298120:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364361600 00000100:00100000:2.0:1782607558.298180:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1782607558.298190:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+18:8458:x1869199364361600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782607558.298444:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+18:8458:x1869199364361600:12345-0@lo:502:llog_process_th.0 Request processed in 255us (3271us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607558.298452:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1782607558.298474:0:8458:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97454894a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:8458:1869199364361600:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782607558.298576:0:8458:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782607558.298584:0:8458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782607558.298587:0:8458:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1782607558.298592:0:8458:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1782607558.298728:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1782607558.298745:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782607558.298754:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9745585ad400/0x8109266df35cb1b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb1b8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607558.299091:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff9745585ad400/0x8109266df35cb1b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb1b8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782607558.299102:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782607558.299104:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff974544151000 from 4 10000000:01000000:0.0:1782607558.299107:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782607558.299135:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974546c42400/0x8109266df35cb1bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607558.299144:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974546c42400/0x8109266df35cb1bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607558.299153:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974546c42400/0x8109266df35cb1bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607558.299573:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364361728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782607558.299634:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607558.299719:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745712a9780 going to sleep for 11 seconds 00000100:00100000:1.0:1782607558.300289:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364361728 00000100:00100000:1.0:1782607558.300297:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364361728 00000100:00100000:1.0:1782607558.300444:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1782607558.300455:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+18:5800:x1869199364361728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782607558.300470:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607558.300484:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9745821d0400/0x8109266df35cb1c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cb1bf expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607558.300520:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9745821d0400/0x8109266df35cb1c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cb1bf expref: 19 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607558.300531:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9745821d0400/0x8109266df35cb1c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cb1bf expref: 19 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607558.300540:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745821d0400, rc 0) 00000100:00100000:1.0:1782607558.300585:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+19:5800:x1869199364361728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607558.300596:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1782607558.300735:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364361728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782607558.300749:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974546c42400/0x8109266df35cb1bf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb1c6 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607558.300758:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974546c42400/0x8109266df35cb1bf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cb1c6 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607558.300967:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364361856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782607558.300996:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607558.301018:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745712a9780 going to sleep for 11 seconds 00000100:00100000:2.0:1782607558.301171:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364361856 00000100:00100000:2.0:1782607558.301176:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364361856 00000100:00100000:2.0:1782607558.301203:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1782607558.301210:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+19:5800:x1869199364361856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782607558.301742:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+19:5800:x1869199364361856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 530us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607558.301749:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1782607558.305451:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364361856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782607558.305524:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97454894a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364361984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782607558.305594:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607558.305643:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff97457f923780 going to sleep for 11 seconds 00000100:00100000:2.0:1782607558.305818:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364361984 00000100:00100000:2.0:1782607558.305826:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364361984 00000100:00100000:2.0:1782607558.306122:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1782607558.306133:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974548ac5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+19:5800:x1869199364361984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782607558.306395:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974548ac5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+19:5800:x1869199364361984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 263us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607558.306402:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1782607558.306576:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97454894a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364361984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782607558.317290:0:8461:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97454894a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:8461:1869199364362112:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782607558.317373:0:8461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607558.317409:0:8461:0:(client.c:2701:ptlrpc_set_wait()) set ffff97457f923cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782607558.318344:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364362112 00000100:00100000:2.0:1782607558.318354:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364362112 00000100:00100000:2.0:1782607558.318402:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1782607558.318411:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974548ac5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+19:8461:x1869199364362112:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782607558.318650:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974548ac5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+19:8461:x1869199364362112:12345-0@lo:502:llog_process_th.0 Request processed in 239us (1277us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607558.318657:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1782607558.318831:0:8461:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97454894a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:8461:1869199364362112:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782607558.318872:0:8461:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782607558.318883:0:8461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782607558.318886:0:8461:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1782607558.318893:0:8461:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff974544151000 00000020:00000080:0.0:1782607558.318895:0:8461:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1782607558.318970:0:8461:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509ef100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:8461:1869199364362240:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782607558.319011:0:8461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607558.319034:0:8461:0:(client.c:2701:ptlrpc_set_wait()) set ffff974581081480 going to sleep for 11 seconds 00000100:00100000:2.0:1782607558.319828:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364362240 00000100:00100000:2.0:1782607558.319835:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364362240 00000100:00100000:2.0:1782607558.319870:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1782607558.319877:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974548ac7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+19:8461:x1869199364362240:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782607558.322871:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974548ac7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+19:8461:x1869199364362240:12345-0@lo:502:llog_process_th.0 Request processed in 2984us (3850us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607558.322887:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1782607558.323020:0:8461:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509ef100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:8461:1869199364362240:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782607558.323054:0:8461:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782607558.323062:0:8461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782607558.323064:0:8461:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1782607558.323080:0:8461:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1782607558.323350:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1782607558.323368:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782607558.323378:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974546c42400/0x8109266df35cb1bf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb1c6 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607558.323389:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974546c42400/0x8109266df35cb1bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb1c6 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607558.854698:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782607559.234366:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364362368:0@lo:400:kworker.0 00000100:00100000:0.0:1782607559.234453:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607559.234678:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364362368 00000100:00100000:1.0:1782607559.234685:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364362368 00000100:00100000:1.0:1782607559.234737:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1782607559.234745:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3319:x1869199364362368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607559.240201:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1869199364362624:0@lo:400:kworker.0 00000100:00100000:3.0:1782607559.240345:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607559.240407:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782607559.240415:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869199364362496:0@lo:400:kworker.0 00000100:00100000:3.0:1782607559.240439:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607559.240474:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364362624 00000100:00100000:3.0:1782607559.240483:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364362624 00000100:00100000:3.0:1782607559.240542:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364362496 00000100:00100000:3.0:1782607559.240545:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364362496 00000100:00100000:3.0:1782607559.240566:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782607559.240575:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974551142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869199364362624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607559.240631:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974551142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869199364362624:12345-0@lo:400:kworker.0 Request processed in 57us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607559.240638:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782607559.240655:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782607559.240661:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974551142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869199364362496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607559.240687:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974551142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869199364362496:12345-0@lo:400:kworker.0 Request processed in 26us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607559.240693:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782607559.240741:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869199364362496:0@lo:400:kworker.0 00000100:00100000:3.0:1782607559.240752:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1869199364362624:0@lo:400:kworker.0 00000100:00080000:3.0:1782607559.240835:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782607559.241513:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364362752:0@lo:400:kworker.0 00000100:00100000:3.0:1782607559.241551:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607559.241621:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364362752 00000100:00100000:3.0:1782607559.241625:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364362752 00000100:00100000:3.0:1782607559.241656:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782607559.241671:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974551141c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364362752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607559.241706:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974551141c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364362752:12345-0@lo:400:kworker.0 Request processed in 35us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607559.241712:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1782607559.241725:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782607559.241742:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974567325f80 x1869199364362752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607575 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607559.241753:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364362752:0@lo:400:kworker.0 00000100:00100000:1.0:1782607559.243576:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3319:x1869199364362368:12345-0@lo:400:kworker.0 Request processed in 8824us (9115us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607559.243591:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1782607559.243829:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364362368:0@lo:400:kworker.0 00000100:00100000:0.0:1782607559.244244:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1869199364362880:0@lo:400:kworker.0 00000100:00100000:0.0:1782607559.244309:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607559.244877:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364362880 00000100:00100000:3.0:1782607559.244885:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364362880 00000100:00100000:3.0:1782607559.244965:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782607559.244976:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745509ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1869199364362880:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1782607559.245058:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782607559.245640:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567325c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364363008:0@lo:400:kworker.0 00000100:00100000:2.0:1782607559.245684:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607559.245739:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364363008 00000100:00100000:2.0:1782607559.245743:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364363008 00000100:00100000:2.0:1782607559.245800:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782607559.245808:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974567327b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364363008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607559.245846:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974567327b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364363008:12345-0@lo:400:kworker.0 Request processed in 38us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607559.245853:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1782607559.245885:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974567325c00 x1869199364363008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607575 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782607559.245899:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567325c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364363008:0@lo:400:kworker.0 00000100:00080000:1.0:1782607559.248648:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782607559.248911:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745509ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1869199364362880:12345-0@lo:400:kworker.0 Request processed in 3932us (4596us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607559.248924:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1782607559.249232:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1869199364362880:0@lo:400:kworker.0 00000100:00100000:2.0:1782607559.749011:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364363136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782607559.749126:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607559.749284:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364363136 00000100:00100000:0.0:1782607559.749295:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364363136 00000100:00100000:0.0:1782607559.749365:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782607559.749377:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974567325c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364363136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782607559.749430:0:6612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782607559.749488:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974567325c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364363136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607559.749496:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1782607559.749582:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9745509edc00 x1869199364363136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607575 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782607559.749603:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364363136:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782607559.875177:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782607560.770136:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782607560.770202:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364363264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782607560.770408:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607560.770478:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364363264 00000100:00100000:2.0:1782607560.770486:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364363264 00000100:00100000:2.0:1782607560.770532:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782607560.770542:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974567327480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364363264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782607560.770648:0:6612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782607560.770711:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974567327480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364363264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 169us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607560.770718:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1782607560.770762:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974567326300 x1869199364363264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607576 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782607560.770801:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364363264:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782607560.901221:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607561.922818:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782607561.960551:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607561.960594:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607561.960618:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607561.960632:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607561.960653:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342312448 00000100:00100000:3.0:1782607561.960661:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342312448 00000100:00100000:3.0:1782607561.960708:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 37 00000100:00100000:3.0:1782607561.960716:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974551141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2355:x1869199342312448:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1782607561.960799:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974551141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2355:x1869199342312448:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 83us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607561.960811:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 37 00000100:00100000:3.0:1782607561.960830:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342312576 00000100:00100000:3.0:1782607561.960833:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342312576 00000100:00100000:3.0:1782607561.960849:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342312704 00000100:00100000:3.0:1782607561.960851:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342312704 00000100:00100000:3.0:1782607561.960860:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 22 00000100:00100000:3.0:1782607561.960863:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974551143b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2354:x1869199342312576:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1782607561.960882:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974551143b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2354:x1869199342312576:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 18us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607561.960885:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 22 00000100:00100000:3.0:1782607561.960892:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 23 00000100:00100000:3.0:1782607561.960895:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974551141500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2355:x1869199342312704:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1782607561.960907:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974551141500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2355:x1869199342312704:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 12us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607561.960910:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 23 00000100:00080000:3.0:1782607561.960920:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782607561.960922:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782607561.960924:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782607561.961252:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342312320 00000100:00100000:0.0:1782607561.961256:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342312320 00000100:00100000:0.0:1782607561.961280:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 193 00000100:00100000:0.0:1782607561.961285:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+10:2354:x1869199342312320:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1782607561.961314:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+10:2354:x1869199342312320:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 30us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607561.961326:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 193 00010000:00010000:3.0:1782607562.946163:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782607563.165230:0:8688:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1782607563.971174:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782607564.354321:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567324e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1869199364363648:0@lo:400:kworker.0 00000100:00100000:2.0:1782607564.354411:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607564.354476:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1782607564.354483:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869199364363520:0@lo:400:kworker.0 00000100:00100000:2.0:1782607564.354519:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607564.354534:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364364032:0@lo:400:kworker.0 00000100:00100000:2.0:1782607564.354559:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607564.354595:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364363648 00000100:00100000:2.0:1782607564.354603:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364363648 00000100:00100000:2.0:1782607564.354653:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364363520 00000100:00100000:2.0:1782607564.354656:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364363520 00000100:00100000:2.0:1782607564.354677:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782607564.354685:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974567324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869199364363648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607564.354755:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974567324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869199364363648:12345-0@lo:400:kworker.0 Request processed in 70us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607564.354762:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782607564.354798:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1782607564.354805:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974567325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869199364363520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607564.354850:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974567325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869199364363520:12345-0@lo:400:kworker.0 Request processed in 46us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607564.354855:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1782607564.354875:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364364032 00000100:00100000:2.0:1782607564.354879:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364364032 00000100:00100000:2.0:1782607564.354904:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782607564.354911:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974567326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364364032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607564.354939:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974567326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364364032:12345-0@lo:400:kworker.0 Request processed in 29us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607564.354945:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1782607564.354960:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782607564.354965:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782607564.355002:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869199364363520:0@lo:400:kworker.0 00010000:00080000:2.0:1782607564.355015:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974567324a80 x1869199364364032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782607564.355035:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364364032:0@lo:400:kworker.0 00000100:00100000:2.0:1782607564.355046:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567324e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1869199364363648:0@lo:400:kworker.0 00000100:00100000:0.0:1782607564.355706:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364363392:0@lo:400:kworker.0 00000100:00100000:0.0:1782607564.355746:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607564.355805:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1869199364363904:0@lo:400:kworker.0 00000100:00100000:0.0:1782607564.355831:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607564.355857:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782607564.355863:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364363776:0@lo:400:kworker.0 00000100:00100000:0.0:1782607564.355911:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607564.355941:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364363776 00000100:00100000:0.0:1782607564.355946:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364363776 00000100:00100000:0.0:1782607564.355981:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782607564.355989:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745509efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364363776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607564.356050:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745509efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364363776:12345-0@lo:400:kworker.0 Request processed in 62us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607564.356056:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1782607564.356073:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782607564.356095:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974567324700 x1869199364363776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782607564.356105:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364363776:0@lo:400:kworker.0 00000100:00100000:3.0:1782607564.356191:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364363904 00000100:00100000:3.0:1782607564.356195:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364363904 00000100:00100000:3.0:1782607564.356234:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782607564.356242:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745509edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1869199364363904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607564.356280:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745509edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1869199364363904:12345-0@lo:400:kworker.0 Request processed in 39us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607564.356295:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782607564.356323:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1869199364363904:0@lo:400:kworker.0 00000100:00100000:1.0:1782607564.357093:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364363392 00000100:00100000:1.0:1782607564.357100:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364363392 00000100:00100000:1.0:1782607564.357148:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1782607564.357164:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3319:x1869199364363392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607564.357212:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3319:x1869199364363392:12345-0@lo:400:kworker.0 Request processed in 49us (1465us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607564.357230:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00080000:0.0:1782607564.357308:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782607564.357505:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364363392:0@lo:400:kworker.0 00000100:00100000:2.0:1782607564.868353:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364364160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782607564.868430:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607564.868544:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364364160 00000100:00100000:0.0:1782607564.868553:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364364160 00000100:00100000:0.0:1782607564.868608:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782607564.868618:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974567324e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364364160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782607564.868656:0:6612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782607564.868705:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974567324e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364364160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607564.868712:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1782607564.868812:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9745509edc00 x1869199364364160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607580 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782607564.868830:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364364160:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782607564.998047:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782607565.899540:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782607565.899563:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974551142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364364288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782607565.899634:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607565.899976:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364364288 00000100:00100000:0.0:1782607565.899985:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364364288 00000100:00100000:0.0:1782607565.900202:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782607565.900213:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974551143480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364364288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782607565.900250:0:6612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782607565.900322:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974551143480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364364288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607565.900330:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1782607565.900510:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974551142d80 x1869199364364288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607581 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782607565.900542:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974551142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364364288:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782607566.020290:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607567.047431:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782607567.088357:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607567.088418:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607567.088448:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342312832 00000100:00100000:3.0:1782607567.088457:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342312832 00000100:00100000:3.0:1782607567.088519:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 195 00000100:00100000:3.0:1782607567.088530:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+10:2357:x1869199342312832:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1782607567.088598:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+10:2357:x1869199342312832:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 70us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607567.088605:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 195 00000100:00100000:1.0:1782607567.090078:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342312960 00000100:00100000:1.0:1782607567.090089:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342312960 00000100:00100000:1.0:1782607567.090172:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 41 00000100:00100000:1.0:1782607567.090183:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974551142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2357:x1869199342312960:12345-192.168.202.4@tcp:400:kworker.0 00000100:00080000:3.0:1782607567.090185:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782607567.090260:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974551142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2357:x1869199342312960:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 79us (1914us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607567.090268:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 41 00000100:00100000:1.0:1782607567.099652:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607567.099695:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607567.099725:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342313088 00000100:00100000:1.0:1782607567.099734:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342313088 00000100:00100000:1.0:1782607567.099804:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342313216 00000100:00100000:1.0:1782607567.099807:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342313216 00000100:00100000:1.0:1782607567.099826:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 10 00000100:00100000:1.0:1782607567.099835:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974548949f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2353:x1869199342313088:12345-192.168.202.4@tcp:9:kworker.0 00000020:00000080:1.0:1782607567.099871:0:6608:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8109266df35cb102 00000100:00080000:1.0:1782607567.099881:0:6608:0:(import.c:65:import_set_state_nolock()) ffff97457fb83000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782607567.099918:0:6608:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1782607567.100299:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974548949f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+2:2353:x1869199342313088:12345-192.168.202.4@tcp:9:kworker.0 Request processed in 463us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607567.100307:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 10 00000100:00100000:1.0:1782607567.100323:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11 00000100:00100000:1.0:1782607567.100330:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97454894bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2353:x1869199342313216:12345-192.168.202.4@tcp:9:kworker.0 00000020:00000080:1.0:1782607567.100345:0:6608:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8109266df35cb109 00000100:00080000:1.0:1782607567.100364:0:6608:0:(import.c:65:import_set_state_nolock()) ffff97457fb86800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782607567.100385:0:6608:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1782607567.100572:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97454894bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+2:2353:x1869199342313216:12345-192.168.202.4@tcp:9:kworker.0 Request processed in 241us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607567.100579:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11 00000100:00080000:1.0:1782607567.100599:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782607567.100603:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782607567.100669:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607567.100816:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782607567.532039:0:8932:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-server.virtnet: executing yml_node 00000001:00100000:2.0:1782607568.010562:0:6634:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d72d7fb9-639f-4ad9-b658-df715cbf7792 00000020:00000080:2.0:1782607568.010574:0:6634:0:(genops.c:906:class_export_put()) final put ffff97457fb87800/d72d7fb9-639f-4ad9-b658-df715cbf7792 00000020:00000080:3.0:1782607568.010643:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97457fb87800/d72d7fb9-639f-4ad9-b658-df715cbf7792 for lustre-OST0000 00000020:00000080:3.0:1782607568.010691:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97457fb83000 for lustre-OST0000 00010000:00010000:3.0:1782607568.066135:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607569.089940:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782607569.474271:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1869199364364672:0@lo:400:kworker.0 00000100:00100000:2.0:1782607569.474346:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607569.474412:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1782607569.474418:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869199364364544:0@lo:400:kworker.0 00000100:00100000:2.0:1782607569.474443:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607569.474462:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364365056:0@lo:400:kworker.0 00000100:00100000:2.0:1782607569.474488:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607569.474529:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364364672 00000100:00100000:2.0:1782607569.474536:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364364672 00000100:00100000:2.0:1782607569.474595:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364364544 00000100:00100000:2.0:1782607569.474599:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364364544 00000100:00100000:2.0:1782607569.474624:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782607569.474634:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455d463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869199364364672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607569.474687:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455d463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869199364364672:12345-0@lo:400:kworker.0 Request processed in 54us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607569.474695:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782607569.474713:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1782607569.474734:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455d462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869199364364544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607569.474786:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455d462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869199364364544:12345-0@lo:400:kworker.0 Request processed in 30us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607569.474793:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1782607569.474821:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364365056 00000100:00100000:2.0:1782607569.474825:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364365056 00000100:00100000:2.0:1782607569.474867:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782607569.474875:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455d463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364365056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607569.474908:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455d463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364365056:12345-0@lo:400:kworker.0 Request processed in 34us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607569.474914:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1782607569.474929:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782607569.474933:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782607569.474965:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869199364364544:0@lo:400:kworker.0 00010000:00080000:2.0:1782607569.474989:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974567324700 x1869199364365056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607585 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782607569.475001:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364365056:0@lo:400:kworker.0 00000100:00100000:2.0:1782607569.475013:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1869199364364672:0@lo:400:kworker.0 00000100:00100000:3.0:1782607569.475213:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364364416:0@lo:400:kworker.0 00000100:00100000:3.0:1782607569.475250:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607569.475280:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1869199364364928:0@lo:400:kworker.0 00000100:00100000:3.0:1782607569.475315:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607569.475356:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782607569.475362:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364364800:0@lo:400:kworker.0 00000100:00100000:3.0:1782607569.475386:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607569.475412:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364364800 00000100:00100000:3.0:1782607569.475416:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364364800 00000100:00080000:0.0:1782607569.475438:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782607569.475447:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782607569.475452:0:6608:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1782607569.475453:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974551140000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364364800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607569.475459:0:6608:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1782607569.475490:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974551140000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364364800:12345-0@lo:400:kworker.0 Request processed in 37us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607569.475497:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1782607569.475506:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974567326300 x1869199364364800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607585 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782607569.475516:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364364800:0@lo:400:kworker.0 00000100:00100000:1.0:1782607569.475650:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364364928 00000100:00100000:1.0:1782607569.475654:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364364928 00000100:00100000:1.0:1782607569.475691:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1782607569.475698:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974551141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1869199364364928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607569.475736:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974551141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1869199364364928:12345-0@lo:400:kworker.0 Request processed in 39us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607569.475741:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1782607569.475788:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1869199364364928:0@lo:400:kworker.0 00000100:00080000:3.0:1782607569.475901:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782607569.476244:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364364416 00000100:00100000:2.0:1782607569.476249:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364364416 00000100:00100000:2.0:1782607569.476424:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1782607569.476431:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3319:x1869199364364416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607569.476477:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3319:x1869199364364416:12345-0@lo:400:kworker.0 Request processed in 47us (1226us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607569.476483:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1782607569.476829:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364364416:0@lo:400:kworker.0 00000100:00100000:1.0:1782607569.986065:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782607569.986090:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364365184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782607569.986157:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607569.986272:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364365184 00000100:00100000:3.0:1782607569.986280:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364365184 00000100:00100000:3.0:1782607569.986334:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782607569.986351:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97454894ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364365184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782607569.986383:0:6612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782607569.986423:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97454894ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364365184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607569.986427:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1782607569.986541:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9745509ef100 x1869199364365184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607585 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607569.986555:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364365184:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782607570.114867:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1782607570.545616:0:7525:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d72d7fb9-639f-4ad9-b658-df715cbf7792 00000020:00000080:3.0:1782607570.545625:0:7525:0:(genops.c:906:class_export_put()) final put ffff97457fb85800/d72d7fb9-639f-4ad9-b658-df715cbf7792 00000020:00000080:0.0:1782607570.545849:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97457fb85800/d72d7fb9-639f-4ad9-b658-df715cbf7792 for lustre-OST0001 00000020:00000080:0.0:1782607570.546344:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97457fb86800 for lustre-OST0001 00000100:00100000:0.0:1782607571.010292:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364365312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782607571.010362:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607571.010975:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364365312 00000100:00100000:3.0:1782607571.010984:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364365312 00000100:00100000:3.0:1782607571.011052:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782607571.011063:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745509eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364365312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782607571.011099:0:6612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782607571.011153:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745509eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364365312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607571.011169:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1782607571.011222:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9745676e9c00 x1869199364365312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607587 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607571.011244:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364365312:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782607571.011324:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782607571.138005:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607572.161875:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782607572.179508:0:9125:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.105 00000100:00100000:3.0:1782607572.206437:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607572.206496:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607572.206594:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342313344 00000100:00100000:0.0:1782607572.206605:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342313344 00000100:00100000:0.0:1782607572.206723:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 197 00000100:00100000:0.0:1782607572.206734:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+10:2356:x1869199342313344:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1782607572.206832:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+10:2356:x1869199342313344:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 100us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607572.206839:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 197 00000100:00100000:2.0:1782607572.207017:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342313472 00000100:00100000:2.0:1782607572.207022:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342313472 00000100:00100000:2.0:1782607572.207077:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 45 00000100:00100000:2.0:1782607572.207084:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2356:x1869199342313472:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607572.207127:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2356:x1869199342313472:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 44us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607572.207142:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 45 00000100:00080000:0.0:1782607572.207607:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782607573.187303:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782607574.023937:0:9223:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.105 00010000:00010000:3.0:1782607574.217518:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782607574.602553:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869199364365568:0@lo:400:kworker.0 00000100:00100000:0.0:1782607574.602627:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607574.602684:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364366080:0@lo:400:kworker.0 00000100:00100000:0.0:1782607574.602711:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607574.602741:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782607574.602748:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1869199364365696:0@lo:400:kworker.0 00000100:00100000:0.0:1782607574.602784:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607574.602970:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364365568 00000100:00100000:0.0:1782607574.602978:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364365568 00000100:00100000:0.0:1782607574.603023:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364365696 00000100:00100000:0.0:1782607574.603026:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364365696 00000100:00100000:0.0:1782607574.603054:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1782607574.603063:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869199364365568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607574.603119:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869199364365568:12345-0@lo:400:kworker.0 Request processed in 57us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607574.603127:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1782607574.603144:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1782607574.603150:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869199364365696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607574.603174:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869199364365696:12345-0@lo:400:kworker.0 Request processed in 25us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607574.603179:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1782607574.603194:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782607574.603223:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1869199364365696:0@lo:400:kworker.0 00000100:00100000:0.0:1782607574.603232:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869199364365568:0@lo:400:kworker.0 00000100:00100000:0.0:1782607574.603279:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364366080 00000100:00100000:0.0:1782607574.603283:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364366080 00000100:00100000:0.0:1782607574.603314:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782607574.603329:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364366080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607574.603363:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364366080:12345-0@lo:400:kworker.0 Request processed in 36us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607574.603369:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1782607574.603386:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1782607574.603403:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974581264e00 x1869199364366080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782607574.603414:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364366080:0@lo:400:kworker.0 00000100:00100000:0.0:1782607574.603450:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364365824:0@lo:400:kworker.0 00000100:00100000:0.0:1782607574.603475:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607574.603494:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782607574.603501:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fae11c6e-4506-4104-bb8c-df42498f7e08:3318:1869199364365440:0@lo:400:kworker.0 00000100:00100000:0.0:1782607574.603527:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607574.603548:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1869199364365952:0@lo:400:kworker.0 00000100:00100000:0.0:1782607574.603567:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607574.603589:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364365952 00000100:00100000:0.0:1782607574.603592:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364365952 00000100:00100000:0.0:1782607574.603618:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1782607574.603624:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869199364365952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607574.603657:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869199364365952:12345-0@lo:400:kworker.0 Request processed in 33us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607574.603662:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1782607574.603691:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782607574.603707:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1869199364365952:0@lo:400:kworker.0 00000100:00100000:0.0:1782607574.603730:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364365824 00000100:00100000:0.0:1782607574.603741:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364365824 00000100:00100000:0.0:1782607574.603797:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782607574.603803:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364365824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607574.604028:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364365824:12345-0@lo:400:kworker.0 Request processed in 224us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607574.604034:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1782607574.604051:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782607574.604068:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9745509edc00 x1869199364365824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782607574.604077:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364365824:0@lo:400:kworker.0 00000100:00100000:0.0:1782607574.604105:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364365440 00000100:00100000:0.0:1782607574.604109:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364365440 00000100:00100000:0.0:1782607574.604133:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1782607574.604139:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3318:x1869199364365440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607574.604172:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3318:x1869199364365440:12345-0@lo:400:kworker.0 Request processed in 33us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607574.604178:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1782607574.604210:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fae11c6e-4506-4104-bb8c-df42498f7e08:3318:1869199364365440:0@lo:400:kworker.0 00000100:00100000:1.0:1782607575.107319:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782607575.107343:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364366208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782607575.107416:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607575.107551:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364366208 00000100:00100000:3.0:1782607575.107559:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364366208 00000100:00100000:3.0:1782607575.107614:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782607575.107624:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974548949c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364366208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782607575.107658:0:6612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782607575.107711:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974548949c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364366208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607575.107718:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1782607575.107800:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974581267800 x1869199364366208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607591 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607575.107830:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364366208:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782607575.234691:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782607576.031189:0:9321:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.105 00000100:00100000:0.0:1782607576.131088:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364366336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782607576.131208:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607576.131354:0:6613:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364366336 00000100:00100000:0.0:1782607576.131363:0:6613:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364366336 00000100:00100000:0.0:1782607576.131451:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782607576.131461:0:6613:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364366336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782607576.131510:0:6613:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782607576.131592:0:6613:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364366336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607576.131608:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1782607576.131645:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782607576.131710:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9745676e9f80 x1869199364366336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607592 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782607576.131730:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364366336:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782607576.260277:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607577.282414:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782607577.332136:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607577.332187:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607577.332552:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342313600 00000100:00100000:1.0:1782607577.332562:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342313600 00000100:00100000:1.0:1782607577.332620:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 199 00000100:00100000:1.0:1782607577.332631:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+10:2356:x1869199342313600:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1782607577.332706:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+10:2356:x1869199342313600:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 76us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607577.332713:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 199 00000100:00100000:2.0:1782607577.333064:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342313728 00000100:00100000:2.0:1782607577.333069:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342313728 00000100:00100000:2.0:1782607577.333112:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 49 00000100:00100000:2.0:1782607577.333118:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2357:x1869199342313728:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607577.333157:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2357:x1869199342313728:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 40us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607577.333163:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 49 00000100:00080000:2.0:1782607577.333178:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1782607577.469053:0:9369:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Jun 27 20:46:17 EDT 2026 00010000:00010000:1.0:1782607578.306876:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607579.332634:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782607579.715249:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364366464:0@lo:400:kworker.0 00000100:00100000:0.0:1782607579.715316:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607579.715411:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364366464 00000100:00100000:1.0:1782607579.715420:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364366464 00000100:00100000:1.0:1782607579.715468:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1782607579.715478:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3319:x1869199364366464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607579.719380:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869199364366592:0@lo:400:kworker.0 00000100:00100000:2.0:1782607579.719571:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607579.719611:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364367104:0@lo:400:kworker.0 00000100:00100000:2.0:1782607579.719635:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607579.719667:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782607579.719674:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d460e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1869199364366720:0@lo:400:kworker.0 00000100:00100000:2.0:1782607579.719693:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607579.719725:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364366592 00000100:00100000:2.0:1782607579.719731:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364366592 00000100:00100000:2.0:1782607579.719787:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364366720 00000100:00100000:2.0:1782607579.719791:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364366720 00000100:00100000:2.0:1782607579.719820:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1782607579.719829:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974567325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869199364366592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607579.719882:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974567325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869199364366592:12345-0@lo:400:kworker.0 Request processed in 53us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607579.719889:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1782607579.719920:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782607579.719935:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974567327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869199364366720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607579.720029:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974567327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869199364366720:12345-0@lo:400:kworker.0 Request processed in 95us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607579.720035:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1782607579.720061:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782607579.720093:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d460e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1869199364366720:0@lo:400:kworker.0 00000100:00100000:2.0:1782607579.720103:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869199364366592:0@lo:400:kworker.0 00000100:00100000:1.0:1782607579.726645:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3319:x1869199364366464:12345-0@lo:400:kworker.0 Request processed in 11157us (11317us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607579.726662:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1782607579.727243:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364366464:0@lo:400:kworker.0 00000100:00100000:0.0:1782607579.727286:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364367104 00000100:00100000:0.0:1782607579.727294:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364367104 00000100:00100000:0.0:1782607579.727354:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782607579.727362:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974567324700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364367104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607579.727439:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974567324700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364367104:12345-0@lo:400:kworker.0 Request processed in 78us (7803us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607579.727446:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782607579.727470:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364366848:0@lo:400:kworker.0 00000100:00100000:0.0:1782607579.727502:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607579.727535:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364366848 00000100:00100000:0.0:1782607579.727538:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364366848 00000100:00100000:0.0:1782607579.727560:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782607579.727566:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364366848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607579.727596:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364366848:12345-0@lo:400:kworker.0 Request processed in 31us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607579.727612:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1782607579.727643:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974567324a80 x1869199364366848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782607579.727654:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364366848:0@lo:400:kworker.0 00000100:00080000:3.0:1782607579.728061:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782607579.728066:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782607579.728220:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1869199364366976:0@lo:400:kworker.0 00000100:00100000:0.0:1782607579.728253:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607579.728737:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364366976 00000100:00100000:2.0:1782607579.728743:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364366976 00000100:00100000:2.0:1782607579.728891:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782607579.728910:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1869199364366976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607579.728956:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1869199364366976:12345-0@lo:400:kworker.0 Request processed in 59us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607579.729037:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1782607579.729074:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974567326300 x1869199364367104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782607579.729089:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364367104:0@lo:400:kworker.0 00000100:00100000:2.0:1782607579.729117:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1869199364366976:0@lo:400:kworker.0 00000100:00080000:0.0:1782607579.729153:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782607580.227058:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364367232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782607580.227131:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607580.227282:0:6613:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364367232 00000100:00100000:0.0:1782607580.227289:0:6613:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364367232 00000100:00100000:0.0:1782607580.227339:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782607580.227349:0:6613:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974567324380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364367232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782607580.227383:0:6613:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782607580.227558:0:6613:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974567324380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364367232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 209us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607580.227565:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1782607580.227618:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974581266a00 x1869199364367232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607596 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782607580.227636:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364367232:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782607580.354008:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782607581.250318:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364367360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782607581.250407:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607581.250851:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364367360 00000100:00100000:3.0:1782607581.250860:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364367360 00000100:00100000:3.0:1782607581.250940:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782607581.250950:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364367360:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782607581.251189:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1782607581.251225:0:6612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782607581.251286:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364367360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 337us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607581.251295:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1782607581.251438:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9745676e9500 x1869199364367360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607597 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607581.251473:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364367360:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782607581.378471:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607582.406843:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782607582.459683:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607582.459739:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607582.460228:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342313856 00000100:00100000:0.0:1782607582.460240:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342313856 00000100:00100000:0.0:1782607582.460322:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 201 00000100:00100000:0.0:1782607582.460332:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+10:2356:x1869199342313856:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1782607582.460413:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+10:2356:x1869199342313856:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 83us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607582.460421:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 201 00000100:00100000:2.0:1782607582.461174:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342313984 00000100:00100000:2.0:1782607582.461182:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342313984 00000100:00100000:2.0:1782607582.461360:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 53 00000100:00100000:2.0:1782607582.461371:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2357:x1869199342313984:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607582.461433:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2357:x1869199342313984:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 64us (1693us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607582.461440:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 53 00000100:00080000:1.0:1782607582.468103:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782607583.427703:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607584.450820:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782607584.834246:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869199364367616:0@lo:400:kworker.0 00000100:00100000:3.0:1782607584.834364:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607584.834433:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364368128:0@lo:400:kworker.0 00000100:00100000:3.0:1782607584.834463:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607584.834500:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782607584.834506:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1869199364367744:0@lo:400:kworker.0 00000100:00100000:3.0:1782607584.834531:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607584.834569:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364368128 00000100:00100000:3.0:1782607584.834578:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364368128 00000100:00100000:3.0:1782607584.834649:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782607584.834660:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364368128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607584.834724:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364368128:12345-0@lo:400:kworker.0 Request processed in 66us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607584.834732:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782607584.834806:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364367616 00000100:00100000:3.0:1782607584.834810:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364367616 00000100:00100000:3.0:1782607584.834834:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364367744 00000100:00100000:3.0:1782607584.834837:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364367744 00000100:00100000:3.0:1782607584.834872:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1782607584.834879:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869199364367616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607584.834927:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869199364367616:12345-0@lo:400:kworker.0 Request processed in 48us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607584.834935:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1782607584.834947:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1782607584.834954:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869199364367744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607584.834980:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869199364367744:12345-0@lo:400:kworker.0 Request processed in 28us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607584.834985:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1782607584.835035:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1869199364367744:0@lo:400:kworker.0 00000100:00100000:3.0:1782607584.835046:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869199364367616:0@lo:400:kworker.0 00010000:00080000:3.0:1782607584.835060:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9745676e8a80 x1869199364368128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607584.835071:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364368128:0@lo:400:kworker.0 00000100:00100000:2.0:1782607584.835537:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364367488:0@lo:400:kworker.0 00000100:00100000:2.0:1782607584.835584:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607584.835628:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1869199364368000:0@lo:400:kworker.0 00000100:00100000:2.0:1782607584.835654:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607584.835677:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782607584.835684:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364367872:0@lo:400:kworker.0 00000100:00100000:2.0:1782607584.835708:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607584.835756:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364368000 00000100:00100000:2.0:1782607584.835761:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364368000 00000100:00100000:2.0:1782607584.835819:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782607584.835825:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974567326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1869199364368000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607584.835877:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974567326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1869199364368000:12345-0@lo:400:kworker.0 Request processed in 51us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607584.835883:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782607584.835907:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364367872 00000100:00100000:2.0:1782607584.835911:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364367872 00000100:00100000:2.0:1782607584.835952:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1782607584.835971:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974567324a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364367872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607584.836006:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974567324a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364367872:12345-0@lo:400:kworker.0 Request processed in 36us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607584.836012:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1782607584.836053:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9745676e8700 x1869199364367872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782607584.836066:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364367872:0@lo:400:kworker.0 00000100:00100000:2.0:1782607584.836077:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1869199364368000:0@lo:400:kworker.0 00000100:00080000:0.0:1782607584.836359:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782607584.836366:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782607584.836368:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782607584.836842:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364367488 00000100:00100000:3.0:1782607584.836851:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364367488 00000100:00100000:3.0:1782607584.836969:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1782607584.836979:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3319:x1869199364367488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607584.837054:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3319:x1869199364367488:12345-0@lo:400:kworker.0 Request processed in 77us (1469us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607584.837061:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1782607584.837163:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364367488:0@lo:400:kworker.0 00000100:00100000:3.0:1782607585.350043:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782607585.350080:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364368256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782607585.350156:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607585.350473:0:6613:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364368256 00000100:00100000:2.0:1782607585.350481:0:6613:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364368256 00000100:00100000:2.0:1782607585.350536:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782607585.350545:0:6613:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364368256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782607585.350588:0:6613:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782607585.350636:0:6613:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364368256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607585.350643:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1782607585.350845:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97455d462d80 x1869199364368256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607601 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607585.350889:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364368256:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782607585.497648:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607586.370474:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364368384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782607586.370575:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607586.370678:0:6613:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364368384 00000100:00100000:2.0:1782607586.370688:0:6613:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364368384 00000100:00100000:2.0:1782607586.370862:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782607586.370874:0:6613:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974548949500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364368384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782607586.370923:0:6613:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1782607586.371822:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782607586.372027:0:6613:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974548949500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364368384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1152us (1449us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607586.372038:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1782607586.372279:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9745676eb800 x1869199364368384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607602 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607586.372307:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364368384:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782607586.498148:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607587.522886:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607587.568822:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607587.568976:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342314112 00000100:00100000:0.0:1782607587.568985:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342314112 00000100:00100000:0.0:1782607587.569037:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 203 00000100:00100000:0.0:1782607587.569047:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+10:2356:x1869199342314112:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1782607587.569118:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+10:2356:x1869199342314112:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 71us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607587.569125:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 203 00000100:00100000:1.0:1782607587.569279:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607587.569682:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342314240 00000100:00100000:2.0:1782607587.569687:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342314240 00000100:00100000:2.0:1782607587.569749:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 57 00000100:00100000:2.0:1782607587.569758:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974548948700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2356:x1869199342314240:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607587.569823:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974548948700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2356:x1869199342314240:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 66us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607587.569830:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 57 00000100:00080000:0.0:1782607587.569997:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782607588.550059:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607589.571172:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607589.956266:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974548949880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364368896:0@lo:400:kworker.0 00000100:00100000:1.0:1782607589.956349:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607589.956414:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1782607589.956421:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974548948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fae11c6e-4506-4104-bb8c-df42498f7e08:3318:1869199364368512:0@lo:400:kworker.0 00000100:00100000:1.0:1782607589.956456:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607589.956486:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97454894a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1869199364369024:0@lo:400:kworker.0 00000100:00100000:1.0:1782607589.956515:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607589.956547:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97454894aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1869199364368768:0@lo:400:kworker.0 00000100:00100000:1.0:1782607589.956569:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607589.956587:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782607589.956602:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97454894b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869199364368640:0@lo:400:kworker.0 00000100:00100000:1.0:1782607589.956622:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607589.956661:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974548949180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364369152:0@lo:400:kworker.0 00000100:00100000:2.0:1782607589.956675:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364369024 00000100:00100000:2.0:1782607589.956691:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364369024 00000100:00100000:2.0:1782607589.956796:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364368768 00000100:00100000:2.0:1782607589.956800:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364368768 00000100:00100000:2.0:1782607589.956829:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364368640 00000100:00100000:2.0:1782607589.956832:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364368640 00000100:00100000:2.0:1782607589.956853:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1782607589.956863:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974548948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869199364369024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607589.957072:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364368896 00000100:00100000:3.0:1782607589.957081:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364368896 00000100:00100000:3.0:1782607589.957134:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782607589.957144:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974548948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364368896:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1782607589.957940:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782607589.958014:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782607589.958416:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974548948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869199364369024:12345-0@lo:400:kworker.0 Request processed in 1548us (1895us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607589.958430:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1782607589.958494:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1782607589.958506:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974548948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869199364368768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607589.958568:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974548948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869199364368768:12345-0@lo:400:kworker.0 Request processed in 61us (1993us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607589.958569:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607589.958588:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1782607589.958602:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1782607589.958612:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97454894a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869199364368640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607589.958646:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364369152 00000100:00100000:0.0:1782607589.958654:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364369152 00000100:00100000:1.0:1782607589.958664:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97454894aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1869199364368768:0@lo:400:kworker.0 00000100:00100000:2.0:1782607589.958681:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97454894a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869199364368640:12345-0@lo:400:kworker.0 Request processed in 69us (2055us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607589.958689:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1782607589.958708:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1782607589.958719:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458153aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364369152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607589.958723:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97454894b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869199364368640:0@lo:400:kworker.0 00000100:00100000:0.0:1782607589.958805:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458153aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364369152:12345-0@lo:400:kworker.0 Request processed in 89us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607589.958826:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1782607589.958860:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97454894a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1869199364369024:0@lo:400:kworker.0 00000100:00080000:0.0:1782607589.958861:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1782607589.959117:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974548949180 x1869199364369152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782607589.959133:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974548949180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364369152:0@lo:400:kworker.0 00000100:00100000:2.0:1782607589.962144:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364368512 00000100:00100000:2.0:1782607589.962168:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364368512 00000100:00100000:2.0:1782607589.962258:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1782607589.962272:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3318:x1869199364368512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607589.962409:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3318:x1869199364368512:12345-0@lo:400:kworker.0 Request processed in 140us (5954us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607589.962418:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1782607589.962506:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974548948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fae11c6e-4506-4104-bb8c-df42498f7e08:3318:1869199364368512:0@lo:400:kworker.0 00000100:00100000:3.0:1782607589.966985:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974548948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364368896:12345-0@lo:400:kworker.0 Request processed in 9777us (10572us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607589.967001:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1782607589.969187:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974548949880 x1869199364368896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782607589.969213:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974548949880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364368896:0@lo:400:kworker.0 00000100:00100000:1.0:1782607590.472925:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364369280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782607590.473026:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607590.475852:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364369280 00000100:00100000:2.0:1782607590.475887:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364369280 00000100:00100000:2.0:1782607590.475999:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782607590.476013:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581538380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364369280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782607590.476077:0:6612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782607590.476441:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581538380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364369280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 429us (3413us total) trans 0 rc 0/0 00010000:00080000:1.0:1782607590.476442:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97455d461500 x1869199364369280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607606 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782607590.476450:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782607590.476468:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364369280:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782607590.594410:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782607591.491635:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782607591.491672:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364369408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782607591.491796:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607591.503172:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364369408 00000100:00100000:3.0:1782607591.503192:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364369408 00000100:00100000:3.0:1782607591.503276:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782607591.503290:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364369408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782607591.503344:0:6612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782607591.503463:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364369408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 176us (11668us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607591.503471:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1782607591.503498:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782607591.503550:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9745676e8e00 x1869199364369408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607607 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607591.503577:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364369408:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782607591.620645:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607592.649040:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607592.686491:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607592.686557:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607592.686826:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342314496 00000100:00100000:2.0:1782607592.686838:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342314496 00000100:00100000:2.0:1782607592.686947:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 61 00000100:00100000:2.0:1782607592.686960:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581538a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2357:x1869199342314496:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607592.687072:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581538a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2357:x1869199342314496:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 114us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607592.687080:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 61 00000100:00080000:3.0:1782607592.687682:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782607592.689266:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342314368 00000100:00100000:0.0:1782607592.689480:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342314368 00000100:00100000:0.0:1782607592.689630:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 205 00000100:00100000:0.0:1782607592.689642:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974550829850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+10:2357:x1869199342314368:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1782607592.689923:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974550829850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+10:2357:x1869199342314368:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 255us (3336us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607592.689933:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 205 00010000:00010000:1.0:1782607593.666132:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782607594.166303:0:10000:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 20:46:33 (1782607593) === 00000100:00100000:1.0:1782607594.523456:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607594.524027:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342314624 00000100:00100000:0.0:1782607594.524038:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342314624 00000100:00100000:1.0:1782607594.524267:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 206 00000100:00100000:1.0:1782607594.524279:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974550829050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+10:8116:x1869199342314624:12345-192.168.202.4@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782607594.524299:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607594.524317:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9745821d0200/0x8109266df35cb1cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffc01 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607594.524346:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9745821d0200/0x8109266df35cb1cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc01 expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607594.524356:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9745821d0200/0x8109266df35cb1cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc01 expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607594.524377:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745821d0200, rc 0) 00000100:00100000:1.0:1782607594.524446:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974550829050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+11:8116:x1869199342314624:12345-192.168.202.4@tcp:101:mount.lustre.0 Request processed in 170us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607594.524452:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 206 00000100:00100000:3.0:1782607594.537372:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607594.537512:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342314752 00000100:00100000:0.0:1782607594.537522:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342314752 00000100:00100000:0.0:1782607594.537584:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 207 00000100:00100000:0.0:1782607594.537595:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+11:8116:x1869199342314752:12345-192.168.202.4@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782607594.537976:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+11:8116:x1869199342314752:12345-192.168.202.4@tcp:501:mount.lustre.0 Request processed in 382us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607594.537985:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 207 00000100:00100000:3.0:1782607594.543594:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607594.543811:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342314880 00000100:00100000:1.0:1782607594.543822:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342314880 00000100:00100000:1.0:1782607594.543888:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 208 00000100:00100000:1.0:1782607594.543899:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+11:8116:x1869199342314880:12345-192.168.202.4@tcp:503:mount.lustre.0 00000100:00100000:1.0:1782607594.545587:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+11:8116:x1869199342314880:12345-192.168.202.4@tcp:503:mount.lustre.0 Request processed in 1681us (1994us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607594.545599:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 208 00000100:00100000:1.0:1782607594.567707:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607594.567927:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342315008 00000100:00100000:2.0:1782607594.567937:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342315008 00000100:00100000:2.0:1782607594.567998:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 209 00000100:00100000:2.0:1782607594.568010:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974550829450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+11:8120:x1869199342315008:12345-192.168.202.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782607594.568340:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974550829450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+11:8120:x1869199342315008:12345-192.168.202.4@tcp:502:llog_process_th.0 Request processed in 331us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607594.568350:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 209 00000100:00100000:3.0:1782607594.598637:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607594.598837:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342315136 00000100:00100000:1.0:1782607594.598848:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342315136 00000100:00100000:2.0:1782607594.599152:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 210 00000100:00100000:2.0:1782607594.599165:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+11:8120:x1869199342315136:12345-192.168.202.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782607594.599460:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+11:8120:x1869199342315136:12345-192.168.202.4@tcp:502:llog_process_th.0 Request processed in 297us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607594.599469:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 210 00000100:00100000:3.0:1782607594.605593:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607594.605696:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342315264 00000100:00100000:0.0:1782607594.605707:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342315264 00000100:00100000:0.0:1782607594.605814:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 211 00000100:00100000:0.0:1782607594.605827:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974550828850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+11:8116:x1869199342315264:12345-192.168.202.4@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782607594.605845:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607594.605864:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974546c43e00/0x8109266df35cb1d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffc2b expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607594.605892:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974546c43e00/0x8109266df35cb1d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc2b expref: 12 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607594.605904:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974546c43e00/0x8109266df35cb1d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc2b expref: 12 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607594.605935:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c43e00, rc 0) 00000100:00100000:0.0:1782607594.606005:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974550828850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+12:8116:x1869199342315264:12345-192.168.202.4@tcp:101:mount.lustre.0 Request processed in 181us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607594.606012:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 211 00000100:00100000:3.0:1782607594.611364:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607594.611450:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342315392 00000100:00100000:1.0:1782607594.611460:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342315392 00000100:00100000:1.0:1782607594.611517:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 212 00000100:00100000:1.0:1782607594.611527:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+12:8116:x1869199342315392:12345-192.168.202.4@tcp:256:mount.lustre.0 20000000:01000000:1.0:1782607594.611552:0:5797:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1782607594.611574:0:5797:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1782607594.611577:0:5797:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1782607594.611580:0:5797:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1782607594.611582:0:5797:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1782607594.613182:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+12:8116:x1869199342315392:12345-192.168.202.4@tcp:256:mount.lustre.0 Request processed in 1651us (1821us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607594.613195:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 212 00000100:00100000:3.0:1782607594.617571:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607594.617912:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342315520 00000100:00100000:2.0:1782607594.617923:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342315520 00000100:00100000:2.0:1782607594.617982:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 213 00000100:00100000:2.0:1782607594.617992:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974550828450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+12:8116:x1869199342315520:12345-192.168.202.4@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782607594.618009:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607594.618104:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9745585acc00/0x8109266df35cb1db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffc32 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607594.618133:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9745585acc00/0x8109266df35cb1db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc32 expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607594.618145:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9745585acc00/0x8109266df35cb1db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc32 expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607594.618153:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585acc00, rc 0) 00000100:00100000:2.0:1782607594.618377:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974550828450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:8116:x1869199342315520:12345-192.168.202.4@tcp:101:mount.lustre.0 Request processed in 385us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607594.618384:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 213 00000100:00100000:3.0:1782607594.625657:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607594.625923:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342315648 00000100:00100000:2.0:1782607594.625934:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342315648 00000100:00100000:2.0:1782607594.625991:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 214 00000100:00100000:2.0:1782607594.626002:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:8116:x1869199342315648:12345-192.168.202.4@tcp:501:mount.lustre.0 00000100:00100000:2.0:1782607594.626381:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:8116:x1869199342315648:12345-192.168.202.4@tcp:501:mount.lustre.0 Request processed in 380us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607594.626390:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 214 00000100:00100000:1.0:1782607594.628520:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607594.629437:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342315776 00000100:00100000:0.0:1782607594.629447:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342315776 00000100:00100000:0.0:1782607594.629517:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 215 00000100:00100000:0.0:1782607594.629527:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:8116:x1869199342315776:12345-192.168.202.4@tcp:503:mount.lustre.0 00000100:00100000:0.0:1782607594.629788:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:8116:x1869199342315776:12345-192.168.202.4@tcp:503:mount.lustre.0 Request processed in 240us (1255us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607594.629797:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 215 00000100:00100000:0.0:1782607594.637856:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607594.637982:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342315904 00000100:00100000:3.0:1782607594.637992:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342315904 00000100:00100000:3.0:1782607594.638056:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 216 00000100:00100000:3.0:1782607594.638068:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:8124:x1869199342315904:12345-192.168.202.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782607594.638328:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:8124:x1869199342315904:12345-192.168.202.4@tcp:502:llog_process_th.0 Request processed in 262us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607594.638335:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 216 00000100:00100000:3.0:1782607594.647096:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607594.647810:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342316032 00000100:00100000:2.0:1782607594.647820:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342316032 00000100:00100000:2.0:1782607594.647921:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 217 00000100:00100000:2.0:1782607594.647932:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974550829c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:8124:x1869199342316032:12345-192.168.202.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782607594.648181:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974550829c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:8124:x1869199342316032:12345-192.168.202.4@tcp:502:llog_process_th.0 Request processed in 251us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607594.648189:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 217 00000100:00100000:1.0:1782607594.654925:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607594.655024:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607594.663652:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342316288 00000100:00100000:2.0:1782607594.664385:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342316288 00000100:00080000:0.0:1782607594.664537:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782607594.665487:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342316160 00000100:00100000:2.0:1782607594.665496:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342316160 00000100:00100000:3.0:1782607594.665569:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 62 00000100:00100000:3.0:1782607594.665584:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458153a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2354:x1869199342316288:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1782607594.665684:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458153a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2354:x1869199342316288:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 104us (10769us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607594.665692:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 62 00000100:00100000:3.0:1782607594.665713:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 10 00000100:00100000:3.0:1782607594.665717:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581539f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2353:x1869199342316160:12345-192.168.202.4@tcp:38:mount.lustre.0 00010000:00080000:3.0:1782607594.665756:0:5805:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 5d45e125-365f-42d9-9f91-770009f5d4b0@192.168.202.4@tcp t0 exp 0000000000000000 cur 253 last 0 00000020:00000080:3.0:1782607594.665827:0:5805:0:(genops.c:1406:class_connect()) connect: client 5d45e125-365f-42d9-9f91-770009f5d4b0, cookie 0x8109266df35cb1e2 00000004:00100000:3.0:1782607594.665859:0:5805:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1782607594.666134:0:5805:0:(import.c:65:import_set_state_nolock()) ffff97454425c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782607594.666168:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581539f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d45e125-365f-42d9-9f91-770009f5d4b0+6:2353:x1869199342316160:12345-192.168.202.4@tcp:38:mount.lustre.0 Request processed in 449us (11144us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607594.666174:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 10 00000100:00100000:0.0:1782607594.683809:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607594.683865:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607594.683961:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342316416 00000100:00100000:1.0:1782607594.683971:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342316416 00000100:00100000:1.0:1782607594.684044:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342316544 00000100:00100000:1.0:1782607594.684048:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342316544 00000100:00100000:1.0:1782607594.684073:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11 00000100:00100000:1.0:1782607594.684081:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d45e125-365f-42d9-9f91-770009f5d4b0+7:0:x1869199342316416:12345-192.168.202.4@tcp:41:mount.lustre.0 00000004:00000024:1.0:1782607594.684123:0:7437:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1782607594.684258:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d45e125-365f-42d9-9f91-770009f5d4b0+7:0:x1869199342316416:12345-192.168.202.4@tcp:41:mount.lustre.0 Request processed in 166us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607594.684265:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11 00000100:00100000:1.0:1782607594.684281:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 12 00000100:00100000:1.0:1782607594.684286:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d45e125-365f-42d9-9f91-770009f5d4b0+6:8116:x1869199342316544:12345-192.168.202.4@tcp:41:mount.lustre.0 00000004:00000024:1.0:1782607594.684296:0:7437:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1782607594.684316:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d45e125-365f-42d9-9f91-770009f5d4b0+6:8116:x1869199342316544:12345-192.168.202.4@tcp:41:mount.lustre.0 Request processed in 30us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607594.684321:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 12 00000100:00080000:0.0:1782607594.684797:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782607594.687234:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607594.687414:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342316672 00000100:00100000:1.0:1782607594.687424:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342316672 00000100:00100000:1.0:1782607594.687502:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 13 00000100:00100000:1.0:1782607594.687515:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d45e125-365f-42d9-9f91-770009f5d4b0+6:8116:x1869199342316672:12345-192.168.202.4@tcp:40:mount.lustre.0 00000100:00100000:1.0:1782607594.687649:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d45e125-365f-42d9-9f91-770009f5d4b0+6:8116:x1869199342316672:12345-192.168.202.4@tcp:40:mount.lustre.0 Request processed in 137us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607594.687657:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 13 00010000:00010000:3.0:1782607594.691577:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607594.693619:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607594.694014:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342316800 00000100:00100000:0.0:1782607594.694094:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342316800 00000100:00100000:0.0:1782607594.694190:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 12 00000100:00100000:0.0:1782607594.694200:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974548949880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1869199342316800:12345-192.168.202.4@tcp:8:mount.lustre.0 00000100:00100000:3.0:1782607594.694535:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00080000:0.0:1782607594.694558:0:6608:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 5d45e125-365f-42d9-9f91-770009f5d4b0@192.168.202.4@tcp t0 exp 0000000000000000 cur 253 last 0 00000020:00000080:0.0:1782607594.694584:0:6608:0:(genops.c:1406:class_connect()) connect: client 5d45e125-365f-42d9-9f91-770009f5d4b0, cookie 0x8109266df35cb1e9 00002000:00100000:0.0:1782607594.694596:0:6608:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5d45e125-365f-42d9-9f91-770009f5d4b0/ffff974580f27800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782607594.694620:0:6608:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1782607594.695106:0:6608:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1782607594.695134:0:6608:0:(import.c:65:import_set_state_nolock()) ffff974580f26800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782607594.695209:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974548949880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d45e125-365f-42d9-9f91-770009f5d4b0+6:2353:x1869199342316800:12345-192.168.202.4@tcp:8:mount.lustre.0 Request processed in 1010us (1599us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607594.695217:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 12 00000100:00100000:3.0:1782607594.695934:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607594.696085:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342316928 00000100:00100000:0.0:1782607594.696092:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342316928 00000100:00100000:0.0:1782607594.696113:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 13 00000100:00100000:0.0:1782607594.696118:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1869199342316928:12345-192.168.202.4@tcp:8:mount.lustre.0 00010000:00080000:0.0:1782607594.696141:0:6608:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 5d45e125-365f-42d9-9f91-770009f5d4b0@192.168.202.4@tcp t0 exp 0000000000000000 cur 253 last 0 00000020:00000080:0.0:1782607594.696163:0:6608:0:(genops.c:1406:class_connect()) connect: client 5d45e125-365f-42d9-9f91-770009f5d4b0, cookie 0x8109266df35cb1f0 00002000:00100000:0.0:1782607594.696172:0:6608:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5d45e125-365f-42d9-9f91-770009f5d4b0/ffff974580f24000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782607594.696189:0:6608:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1782607594.696345:0:6608:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1782607594.696365:0:6608:0:(import.c:65:import_set_state_nolock()) ffff974580f24800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782607594.696405:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d45e125-365f-42d9-9f91-770009f5d4b0+6:2353:x1869199342316928:12345-192.168.202.4@tcp:8:mount.lustre.0 Request processed in 286us (1870us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607594.696412:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 13 00000100:00100000:0.0:1782607594.696431:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342317056 00000100:00100000:0.0:1782607594.696434:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342317056 00000100:00100000:0.0:1782607594.696461:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1 00000100:00100000:0.0:1782607594.696466:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d45e125-365f-42d9-9f91-770009f5d4b0+6:8116:x1869199342317056:12345-192.168.202.4@tcp:33:mount.lustre.0 00000004:00200000:0.0:1782607594.697012:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1782607594.697146:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d45e125-365f-42d9-9f91-770009f5d4b0+6:8116:x1869199342317056:12345-192.168.202.4@tcp:33:mount.lustre.0 Request processed in 677us (1212us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607594.697155:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1 00000100:00100000:1.0:1782607595.075146:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364369920:0@lo:400:kworker.0 00000100:00100000:1.0:1782607595.075254:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607595.075327:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1782607595.075334:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fae11c6e-4506-4104-bb8c-df42498f7e08:3318:1869199364369536:0@lo:400:kworker.0 00000100:00100000:1.0:1782607595.075364:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607595.075388:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1869199364370048:0@lo:400:kworker.0 00000100:00100000:1.0:1782607595.075410:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607595.075439:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1869199364369792:0@lo:400:kworker.0 00000100:00100000:1.0:1782607595.075462:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607595.075480:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782607595.075485:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869199364369664:0@lo:400:kworker.0 00000100:00100000:1.0:1782607595.075505:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607595.075523:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364370176:0@lo:400:kworker.0 00000100:00100000:1.0:1782607595.075543:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607595.075573:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364369920 00000100:00100000:1.0:1782607595.075579:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364369920 00000100:00100000:1.0:1782607595.075630:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364370176 00000100:00100000:1.0:1782607595.075634:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364370176 00000100:00100000:1.0:1782607595.075670:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782607595.075680:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974548948e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364369920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607595.075732:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974548948e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364369920:12345-0@lo:400:kworker.0 Request processed in 55us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607595.075738:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782607595.075752:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1782607595.075758:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97454894aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364370176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607595.075826:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97454894aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364370176:12345-0@lo:400:kworker.0 Request processed in 67us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607595.075843:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1782607595.075860:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782607595.075864:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782607595.075893:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9745676e8700 x1869199364370176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607595.075907:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364370176:0@lo:400:kworker.0 00010000:00080000:1.0:1782607595.075948:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9745676eb480 x1869199364369920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607595.075957:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364369920:0@lo:400:kworker.0 00000100:00100000:1.0:1782607595.075978:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364370048 00000100:00100000:1.0:1782607595.075982:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364370048 00000100:00100000:1.0:1782607595.076011:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364369792 00000100:00100000:0.0:1782607595.076495:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364369536 00000100:00100000:0.0:1782607595.076508:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364369536 00000100:00100000:0.0:1782607595.076538:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1782607595.076545:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3318:x1869199364369536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607595.076586:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3318:x1869199364369536:12345-0@lo:400:kworker.0 Request processed in 42us (1221us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607595.076592:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1782607595.076623:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364369664 00000100:00100000:0.0:1782607595.076627:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364369664 00000100:00100000:0.0:1782607595.076643:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1782607595.076649:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974548949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869199364370048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607595.076693:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974548949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869199364370048:12345-0@lo:400:kworker.0 Request processed in 44us (1282us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607595.076699:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1782607595.076710:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1782607595.076715:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97454894b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869199364369664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607595.076744:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97454894b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869199364369664:12345-0@lo:400:kworker.0 Request processed in 28us (1237us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607595.076749:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1782607595.076804:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782607595.076836:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fae11c6e-4506-4104-bb8c-df42498f7e08:3318:1869199364369536:0@lo:400:kworker.0 00000100:00100000:0.0:1782607595.076848:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1869199364370048:0@lo:400:kworker.0 00000100:00100000:0.0:1782607595.076890:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869199364369664:0@lo:400:kworker.0 00000100:00100000:1.0:1782607595.077391:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364369792 00000100:00100000:1.0:1782607595.079895:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1782607595.079924:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97454894a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869199364369792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607595.080039:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97454894a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869199364369792:12345-0@lo:400:kworker.0 Request processed in 129us (4575us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607595.080046:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1782607595.080150:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1869199364369792:0@lo:400:kworker.0 00000100:00080000:0.0:1782607595.080385:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782607595.586478:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364370304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782607595.586571:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607595.586839:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364370304 00000100:00100000:1.0:1782607595.586849:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364370304 00000100:00100000:1.0:1782607595.586913:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1782607595.586924:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364370304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782607595.586954:0:6612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782607595.587007:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364370304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607595.587026:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1782607595.587073:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9745676c8000 x1869199364370304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607611 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607595.587093:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364370304:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782607595.717155:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1782607596.166147:0:7525:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5d45e125-365f-42d9-9f91-770009f5d4b0 00000100:00100000:3.0:1782607596.614486:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364370432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782607596.614583:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607596.628563:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364370432 00000100:00100000:3.0:1782607596.628583:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364370432 00000100:00100000:3.0:1782607596.630578:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782607596.630599:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364370432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782607596.630732:0:6612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782607596.630879:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364370432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 287us (16297us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607596.630888:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1782607596.630987:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9745676e9500 x1869199364370432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607612 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607596.631029:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364370432:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1782607596.697046:0:5825:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5d45e125-365f-42d9-9f91-770009f5d4b0 00010000:00010000:0.0:1782607596.739502:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607597.762152:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1782607598.778157:0:6634:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5d45e125-365f-42d9-9f91-770009f5d4b0 00010000:00010000:2.0:1782607598.789464:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607599.810062:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782607599.853104:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607599.853164:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607599.853192:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342317184 00000100:00100000:1.0:1782607599.853206:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342317184 00000100:00100000:2.0:1782607599.853213:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607599.853255:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607599.853272:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 219 00000100:00100000:1.0:1782607599.853283:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974550828c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2354:x1869199342317184:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1782607599.853327:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342317440 00000100:00100000:3.0:1782607599.853334:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342317440 00000100:00100000:2.0:1782607599.853354:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607599.853389:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974550828c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2354:x1869199342317184:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 102us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607599.853400:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 219 00000100:00100000:3.0:1782607599.853401:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342317312 00000100:00100000:3.0:1782607599.853406:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342317312 00000100:00100000:0.0:1782607599.853431:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342317696 00000100:00100000:0.0:1782607599.853437:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342317696 00000100:00100000:3.0:1782607599.853441:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 66 00000100:00100000:1.0:1782607599.853444:0:9088:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342317568 00000100:00100000:1.0:1782607599.853449:0:9088:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342317568 00000100:00100000:3.0:1782607599.853455:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455d460e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2354:x1869199342317440:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1782607599.853482:0:9088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 38 00000100:00100000:0.0:1782607599.853488:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 39 00000100:00100000:1.0:1782607599.853490:0:9088:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457ff1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2354:x1869199342317568:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1782607599.853495:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455d461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2354:x1869199342317696:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607599.853663:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 67 00000100:00100000:2.0:1782607599.853673:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455d462d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2354:x1869199342317312:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607599.853707:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455d462d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2354:x1869199342317312:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 36us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607599.853713:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 67 00000100:00080000:2.0:1782607599.853822:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782607599.853827:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782607599.853830:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782607599.861924:0:9088:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457ff1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2354:x1869199342317568:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 8415us (8551us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607599.861947:0:9088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 38 00000100:00100000:3.0:1782607599.862926:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455d460e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2354:x1869199342317440:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 9466us (9750us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607599.862940:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 66 00000100:00100000:0.0:1782607599.863098:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455d461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2354:x1869199342317696:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 9600us (9879us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607599.863107:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 39 00000100:00100000:1.0:1782607600.196203:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1869199364370816:0@lo:400:kworker.0 00000100:00100000:1.0:1782607600.196303:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607600.196382:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782607600.196389:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869199364370688:0@lo:400:kworker.0 00000100:00100000:1.0:1782607600.196417:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607600.196438:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364371200:0@lo:400:kworker.0 00000100:00100000:1.0:1782607600.196487:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607600.196533:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364371200 00000100:00100000:1.0:1782607600.196540:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364371200 00000100:00100000:1.0:1782607600.196598:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782607600.196606:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364371200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607600.196669:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364371200:12345-0@lo:400:kworker.0 Request processed in 62us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607600.196677:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1782607600.196717:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782607600.196730:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364370816 00000100:00100000:1.0:1782607600.196742:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364370816 00000100:00100000:1.0:1782607600.196798:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364370688 00000100:00100000:1.0:1782607600.196801:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364370688 00000100:00100000:1.0:1782607600.196815:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1782607600.196819:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869199364370816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607600.196843:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869199364370816:12345-0@lo:400:kworker.0 Request processed in 24us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607600.196847:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1782607600.196853:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1782607600.196856:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869199364370688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607600.196870:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869199364370688:12345-0@lo:400:kworker.0 Request processed in 13us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607600.196874:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1782607600.196885:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782607600.196912:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869199364370688:0@lo:400:kworker.0 00010000:00080000:1.0:1782607600.196922:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9745676cb100 x1869199364371200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607600.196940:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364371200:0@lo:400:kworker.0 00000100:00100000:1.0:1782607600.196948:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1869199364370816:0@lo:400:kworker.0 00000100:00100000:3.0:1782607600.199084:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364370560:0@lo:400:kworker.0 00000100:00100000:3.0:1782607600.199188:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607600.199250:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1869199364371072:0@lo:400:kworker.0 00000100:00100000:3.0:1782607600.199278:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607600.199317:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782607600.199325:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364370944:0@lo:400:kworker.0 00000100:00100000:3.0:1782607600.199355:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607600.199395:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364371072 00000100:00100000:3.0:1782607600.199404:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364371072 00000100:00100000:3.0:1782607600.199461:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1782607600.199470:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1869199364371072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607600.199526:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1869199364371072:12345-0@lo:400:kworker.0 Request processed in 57us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607600.199551:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1782607600.199599:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1869199364371072:0@lo:400:kworker.0 00000100:00100000:2.0:1782607600.199890:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364370560 00000100:00100000:2.0:1782607600.199895:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364370560 00000100:00100000:2.0:1782607600.199929:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1782607600.199935:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974550828050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3319:x1869199364370560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607600.199969:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974550828050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3319:x1869199364370560:12345-0@lo:400:kworker.0 Request processed in 34us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607600.199975:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1782607600.200185:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364370560:0@lo:400:kworker.0 00000100:00080000:1.0:1782607600.200600:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782607600.200620:0:9088:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364370944 00000100:00100000:1.0:1782607600.200624:0:9088:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364370944 00000100:00100000:1.0:1782607600.200677:0:9088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782607600.200682:0:9088:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364370944:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1782607600.200887:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782607600.201017:0:9088:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364370944:12345-0@lo:400:kworker.0 Request processed in 333us (1660us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607600.201025:0:9088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1782607600.201263:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9745676c9880 x1869199364370944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607600.201278:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364370944:0@lo:400:kworker.0 00000100:00100000:2.0:1782607600.706305:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364371328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782607600.706404:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607600.706655:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364371328 00000100:00100000:1.0:1782607600.706666:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364371328 00000100:00100000:1.0:1782607600.706743:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782607600.706754:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457ff1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364371328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782607600.706849:0:6612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782607600.706916:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457ff1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364371328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 162us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607600.706925:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1782607600.707047:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9745676ca680 x1869199364371328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607616 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782607600.707069:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364371328:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782607600.836266:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782607601.462076:0:10198:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:0.0:1782607601.730142:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364371456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782607601.730255:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607601.743067:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364371456 00000100:00100000:1.0:1782607601.743088:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364371456 00000100:00100000:1.0:1782607601.743163:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782607601.743175:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581267b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364371456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782607601.743330:0:6612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782607601.743450:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581267b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364371456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 276us (13194us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607601.743478:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1782607601.744048:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9745676e8380 x1869199364371456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607617 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782607601.744076:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364371456:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782607601.860512:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607602.887421:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607603.908241:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607604.930240:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782607604.977882:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607604.977980:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607604.978021:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607604.978052:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607604.978119:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607604.978159:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342318336 00000100:00100000:2.0:1782607604.978169:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342318336 00000100:00100000:2.0:1782607604.978223:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342318208 00000100:00100000:2.0:1782607604.978225:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342318208 00000100:00100000:2.0:1782607604.978264:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 42 00000100:00100000:2.0:1782607604.978275:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745799e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2355:x1869199342318336:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607604.978350:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745799e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2355:x1869199342318336:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 76us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607604.978357:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 42 00000100:00100000:2.0:1782607604.978526:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 43 00000100:00100000:2.0:1782607604.978533:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457ff1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2355:x1869199342318208:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607604.978557:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457ff1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2355:x1869199342318208:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 24us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607604.978564:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 43 00000100:00080000:2.0:1782607604.978595:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782607604.978599:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782607604.979175:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342318080 00000100:00100000:1.0:1782607604.979181:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342318080 00000100:00100000:1.0:1782607604.979226:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342317952 00000100:00100000:1.0:1782607604.979229:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342317952 00000100:00100000:1.0:1782607604.979270:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 71 00000100:00100000:1.0:1782607604.979279:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457ff1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2355:x1869199342318080:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1782607604.979324:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457ff1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2355:x1869199342318080:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 47us (1344us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607604.979332:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 71 00000100:00100000:1.0:1782607604.979348:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 72 00000100:00100000:1.0:1782607604.979356:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457ff1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2355:x1869199342317952:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1782607604.979381:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457ff1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2355:x1869199342317952:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 26us (1329us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607604.979387:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 72 00000100:00080000:2.0:1782607604.980064:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782607604.985682:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342317824 00000100:00100000:0.0:1782607604.985707:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342317824 00000100:00100000:2.0:1782607604.987206:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 221 00000100:00100000:2.0:1782607604.987224:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2355:x1869199342317824:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607604.987323:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2355:x1869199342317824:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 106us (9451us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607604.987332:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 221 00000100:00100000:2.0:1782607605.314465:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457ff1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364371968:0@lo:400:kworker.0 00000100:00100000:2.0:1782607605.314541:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607605.314615:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782607605.314622:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457ff1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fae11c6e-4506-4104-bb8c-df42498f7e08:3318:1869199364371584:0@lo:400:kworker.0 00000100:00100000:2.0:1782607605.314651:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607605.314676:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457ff1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1869199364372096:0@lo:400:kworker.0 00000100:00100000:2.0:1782607605.314711:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607605.314738:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457ff1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869199364371712:0@lo:400:kworker.0 00000100:00100000:2.0:1782607605.314780:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607605.314800:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457ff1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364372224:0@lo:400:kworker.0 00000100:00100000:2.0:1782607605.314820:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607605.314836:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782607605.314840:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457ff1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1869199364371840:0@lo:400:kworker.0 00000100:00100000:2.0:1782607605.314875:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607605.314908:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364371968 00000100:00100000:2.0:1782607605.314916:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364371968 00000100:00100000:2.0:1782607605.314963:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364372224 00000100:00100000:2.0:1782607605.314966:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364372224 00000100:00100000:2.0:1782607605.315004:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1782607605.315012:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457ff1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364371968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607605.315061:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457ff1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364371968:12345-0@lo:400:kworker.0 Request processed in 50us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607605.315068:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1782607605.315083:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1782607605.315089:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457ff1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364372224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607605.315118:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457ff1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364372224:12345-0@lo:400:kworker.0 Request processed in 30us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607605.315124:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1782607605.315141:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364371584 00000100:00100000:2.0:1782607605.315144:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364371584 00000100:00100000:2.0:1782607605.315165:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1782607605.315172:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3318:x1869199364371584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607605.315196:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364372096 00000100:00100000:1.0:1782607605.315202:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364372096 00000100:00100000:2.0:1782607605.315203:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3318:x1869199364371584:12345-0@lo:400:kworker.0 Request processed in 31us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607605.315212:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1782607605.315233:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364371712 00000100:00100000:1.0:1782607605.315237:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364371712 00000100:00080000:2.0:1782607605.315243:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782607605.315250:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782607605.315253:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364371840 00000100:00080000:2.0:1782607605.315254:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782607605.315258:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364371840 00000100:00100000:1.0:1782607605.315284:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00010000:00080000:2.0:1782607605.315293:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97457ff1ea00 x1869199364372224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607605.315294:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457ff1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869199364372096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607605.315313:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457ff1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364372224:0@lo:400:kworker.0 00000100:00080000:2.0:1782607605.315339:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782607605.315341:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457ff1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869199364372096:12345-0@lo:400:kworker.0 Request processed in 48us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607605.315349:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1782607605.315355:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457ff1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fae11c6e-4506-4104-bb8c-df42498f7e08:3318:1869199364371584:0@lo:400:kworker.0 00000100:00100000:2.0:1782607605.315371:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457ff1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1869199364372096:0@lo:400:kworker.0 00000100:00100000:1.0:1782607605.315377:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00010000:00080000:2.0:1782607605.315393:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97457ff1e680 x1869199364371968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607605.315405:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457ff1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869199364371712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607605.315406:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457ff1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364371968:0@lo:400:kworker.0 00000100:00100000:1.0:1782607605.315449:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457ff1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869199364371712:12345-0@lo:400:kworker.0 Request processed in 48us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607605.315456:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1782607605.315475:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457ff1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869199364371712:0@lo:400:kworker.0 00000100:00100000:1.0:1782607605.315486:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1782607605.315495:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457ff1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869199364371840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607605.315534:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457ff1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869199364371840:12345-0@lo:400:kworker.0 Request processed in 40us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607605.315540:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1782607605.315621:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457ff1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1869199364371840:0@lo:400:kworker.0 00000100:00100000:2.0:1782607605.828158:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364372352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782607605.828218:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607605.828297:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364372352 00000100:00100000:1.0:1782607605.828303:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364372352 00000100:00100000:1.0:1782607605.828353:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1782607605.828363:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457ff1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364372352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782607605.828402:0:6612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782607605.828450:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457ff1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364372352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607605.828457:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1782607605.828492:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9745676cb100 x1869199364372352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607621 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607605.828506:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364372352:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782607605.965873:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782607606.850963:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782607606.850991:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364372480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782607606.851056:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607606.851111:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364372480 00000100:00100000:3.0:1782607606.851118:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364372480 00000100:00100000:3.0:1782607606.851165:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782607606.851172:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364372480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782607606.851203:0:6612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782607606.851236:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364372480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607606.851241:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1782607606.851270:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9745676eb100 x1869199364372480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607622 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607606.851285:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364372480:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782607606.989276:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607608.003316:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607609.025978:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607610.051047:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782607610.090083:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607610.090162:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342318592 00000100:00100000:1.0:1782607610.090173:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342318592 00000100:00100000:1.0:1782607610.090268:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 76 00000100:00100000:1.0:1782607610.090283:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457ff1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2355:x1869199342318592:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1782607610.090399:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457ff1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2355:x1869199342318592:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 120us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607610.090406:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 76 00000100:00100000:2.0:1782607610.090485:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00080000:3.0:1782607610.090523:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782607610.090535:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607610.090566:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607610.090572:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342318464 00000100:00100000:3.0:1782607610.090577:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342318464 00000100:00100000:2.0:1782607610.090606:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607610.090617:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 223 00000100:00100000:3.0:1782607610.090626:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2355:x1869199342318464:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607610.090639:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342318720 00000100:00100000:2.0:1782607610.090644:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342318720 00000100:00100000:3.0:1782607610.090674:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2355:x1869199342318464:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 49us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607610.090682:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 223 00000100:00080000:3.0:1782607610.090733:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782607610.090749:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 77 00000100:00100000:2.0:1782607610.090758:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457ff1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2355:x1869199342318720:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607610.090825:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457ff1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2355:x1869199342318720:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 68us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607610.090832:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 77 00000100:00100000:2.0:1782607610.090856:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342318848 00000100:00100000:2.0:1782607610.090860:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342318848 00000100:00100000:2.0:1782607610.090900:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342318976 00000100:00100000:2.0:1782607610.090903:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342318976 00000100:00100000:2.0:1782607610.090926:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 46 00000100:00100000:2.0:1782607610.090943:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457ff1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2355:x1869199342318848:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607610.090971:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457ff1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2355:x1869199342318848:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 29us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607610.090978:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 46 00000100:00100000:2.0:1782607610.090988:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 47 00000100:00100000:2.0:1782607610.090993:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457ff1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2355:x1869199342318976:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607610.091012:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457ff1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2355:x1869199342318976:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 19us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607610.091018:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 47 00000100:00080000:3.0:1782607610.091091:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782607610.091095:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782607610.434182:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869199364372736:0@lo:400:kworker.0 00000100:00100000:0.0:1782607610.434255:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607610.434310:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364373248:0@lo:400:kworker.0 00000100:00100000:0.0:1782607610.434336:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607610.434381:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782607610.434388:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1869199364372864:0@lo:400:kworker.0 00000100:00100000:0.0:1782607610.434411:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607610.434446:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364372736 00000100:00100000:0.0:1782607610.434453:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364372736 00000100:00100000:0.0:1782607610.434493:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364372864 00000100:00100000:0.0:1782607610.434497:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364372864 00000100:00100000:0.0:1782607610.434540:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1782607610.434549:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869199364372736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607610.434597:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869199364372736:12345-0@lo:400:kworker.0 Request processed in 50us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607610.434604:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1782607610.434620:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1782607610.434626:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745509ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869199364372864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607610.434663:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745509ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869199364372864:12345-0@lo:400:kworker.0 Request processed in 37us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607610.434669:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1782607610.434687:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364373248 00000100:00100000:0.0:1782607610.434690:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364373248 00000100:00100000:0.0:1782607610.434716:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1782607610.434722:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364373248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607610.434748:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364373248:12345-0@lo:400:kworker.0 Request processed in 27us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607610.434753:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1782607610.434806:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782607610.434811:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782607610.435194:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1869199364372864:0@lo:400:kworker.0 00000100:00100000:0.0:1782607610.435205:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869199364372736:0@lo:400:kworker.0 00010000:00080000:0.0:1782607610.435216:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974581266680 x1869199364373248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782607610.435225:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364373248:0@lo:400:kworker.0 00000100:00100000:1.0:1782607610.435666:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364372992:0@lo:400:kworker.0 00000100:00100000:1.0:1782607610.435705:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607610.435740:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1782607610.435747:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fae11c6e-4506-4104-bb8c-df42498f7e08:3318:1869199364372608:0@lo:400:kworker.0 00000100:00100000:1.0:1782607610.435802:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607610.435831:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1869199364373120:0@lo:400:kworker.0 00000100:00100000:1.0:1782607610.435854:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607610.435880:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364372608 00000100:00100000:1.0:1782607610.435884:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364372608 00000100:00100000:1.0:1782607610.435930:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1782607610.435937:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3318:x1869199364372608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607610.435972:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3318:x1869199364372608:12345-0@lo:400:kworker.0 Request processed in 35us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607610.435978:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1782607610.436003:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364373120 00000100:00100000:1.0:1782607610.436006:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364373120 00000100:00100000:1.0:1782607610.436033:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1782607610.436039:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869199364373120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607610.436066:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869199364373120:12345-0@lo:400:kworker.0 Request processed in 27us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607610.436071:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1782607610.436090:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782607610.436121:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fae11c6e-4506-4104-bb8c-df42498f7e08:3318:1869199364372608:0@lo:400:kworker.0 00000100:00100000:1.0:1782607610.436148:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1869199364373120:0@lo:400:kworker.0 00000100:00100000:0.0:1782607610.436886:0:9088:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364372992 00000100:00100000:0.0:1782607610.436908:0:9088:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364372992 00000100:00100000:0.0:1782607610.436951:0:9088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1782607610.436958:0:9088:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364372992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607610.437005:0:9088:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364372992:12345-0@lo:400:kworker.0 Request processed in 48us (1299us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607610.437011:0:9088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1782607610.437113:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782607610.437151:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974581264380 x1869199364372992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607610.437164:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364372992:0@lo:400:kworker.0 00000100:00100000:2.0:1782607610.945938:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782607610.945965:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364373376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782607610.946046:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607610.946172:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364373376 00000100:00100000:1.0:1782607610.946180:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364373376 00000100:00100000:1.0:1782607610.946236:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1782607610.946244:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457ff1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364373376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782607610.946281:0:6612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00010000:00080000:2.0:1782607610.946485:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9745676cbb80 x1869199364373376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607626 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782607610.946504:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364373376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782607610.946563:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457ff1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364373376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607610.946580:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:0.0:1782607611.074998:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607611.972295:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364373504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782607611.972365:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607611.972557:0:6613:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364373504 00000100:00100000:1.0:1782607611.972564:0:6613:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364373504 00000100:00100000:1.0:1782607611.972606:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1782607611.972614:0:6613:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364373504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782607611.972657:0:6613:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782607611.972701:0:6613:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364373504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607611.972708:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1782607611.974063:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9745676c9500 x1869199364373504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607627 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607611.974097:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364373504:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782607612.098911:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607613.128214:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607614.149270:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607615.170604:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607615.212788:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607615.212830:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607615.212874:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607615.212914:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607615.212939:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607615.213105:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342319104 00000100:00100000:2.0:1782607615.213117:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342319104 00000100:00100000:2.0:1782607615.213205:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 225 00000100:00100000:2.0:1782607615.213217:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2356:x1869199342319104:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607615.213300:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2356:x1869199342319104:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 86us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607615.213321:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 225 00000100:00100000:1.0:1782607615.214029:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342319488 00000100:00100000:1.0:1782607615.214035:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342319488 00000100:00100000:1.0:1782607615.214080:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342319616 00000100:00100000:1.0:1782607615.214083:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342319616 00000100:00100000:1.0:1782607615.214108:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 14 00000100:00100000:1.0:1782607615.214116:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2353:x1869199342319488:12345-192.168.202.4@tcp:9:kworker.0 00000020:00000080:1.0:1782607615.214157:0:6608:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8109266df35cb1e9 00000100:00080000:1.0:1782607615.214167:0:6608:0:(import.c:65:import_set_state_nolock()) ffff974580f26800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782607615.214206:0:6608:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1782607615.214595:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d45e125-365f-42d9-9f91-770009f5d4b0+2:2353:x1869199342319488:12345-192.168.202.4@tcp:9:kworker.0 Request processed in 479us (1840us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607615.214602:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 14 00000100:00100000:1.0:1782607615.214627:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15 00000100:00100000:1.0:1782607615.214634:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2353:x1869199342319616:12345-192.168.202.4@tcp:9:kworker.0 00000020:00000080:1.0:1782607615.214646:0:6608:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8109266df35cb1f0 00000100:00080000:1.0:1782607615.214652:0:6608:0:(import.c:65:import_set_state_nolock()) ffff974580f24800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782607615.214672:0:6608:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1782607615.214908:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d45e125-365f-42d9-9f91-770009f5d4b0+2:2353:x1869199342319616:12345-192.168.202.4@tcp:9:kworker.0 Request processed in 274us (2077us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607615.214929:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15 00000100:00080000:2.0:1782607615.215561:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782607615.215567:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782607615.215577:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607615.215582:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782607615.216307:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342319360 00000100:00100000:2.0:1782607615.216316:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342319360 00000100:00100000:2.0:1782607615.216381:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342319232 00000100:00100000:2.0:1782607615.216384:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342319232 00000100:00100000:2.0:1782607615.216414:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 81 00000100:00100000:2.0:1782607615.216421:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2356:x1869199342319360:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607615.216499:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2356:x1869199342319360:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 78us (3583us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607615.216506:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 81 00000100:00100000:2.0:1782607615.216524:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 82 00000100:00100000:2.0:1782607615.216531:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2356:x1869199342319232:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607615.216555:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2356:x1869199342319232:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 26us (3616us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607615.216561:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 82 00000100:00080000:1.0:1782607615.216923:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782607615.555232:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457ff1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364373632:0@lo:400:kworker.0 00000100:00100000:3.0:1782607615.555314:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607615.555646:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457ff1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869199364373760:0@lo:400:kworker.0 00000100:00100000:2.0:1782607615.555692:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607615.555730:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580c05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364374272:0@lo:400:kworker.0 00000100:00100000:2.0:1782607615.555757:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607615.555815:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782607615.555822:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457ff1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1869199364373888:0@lo:400:kworker.0 00000100:00100000:2.0:1782607615.555859:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607615.555890:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364373760 00000100:00100000:2.0:1782607615.555898:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364373760 00000100:00100000:2.0:1782607615.555952:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364373888 00000100:00100000:2.0:1782607615.555956:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364373888 00000100:00100000:2.0:1782607615.555998:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1782607615.556007:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580c07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869199364373760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607615.556104:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580c04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364374016:0@lo:400:kworker.0 00000100:00100000:3.0:1782607615.556144:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607615.556179:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782607615.556186:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580c07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1869199364374144:0@lo:400:kworker.0 00000100:00100000:3.0:1782607615.556209:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607615.556228:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364374144 00000100:00100000:3.0:1782607615.556231:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364374144 00000100:00100000:3.0:1782607615.556251:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1782607615.556257:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869199364373888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607615.556305:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869199364373888:12345-0@lo:400:kworker.0 Request processed in 47us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607615.556312:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1782607615.556333:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1782607615.556338:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869199364374144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607615.556366:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869199364374144:12345-0@lo:400:kworker.0 Request processed in 28us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607615.556371:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1782607615.556389:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364374272 00000100:00100000:3.0:1782607615.556392:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364374272 00000100:00100000:3.0:1782607615.556413:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364374016 00000100:00100000:3.0:1782607615.556416:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364374016 00000100:00100000:3.0:1782607615.556435:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1782607615.556441:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364374272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607615.556469:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364374272:12345-0@lo:400:kworker.0 Request processed in 28us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607615.556476:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1782607615.556486:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1782607615.556504:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364374016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607615.556528:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364374016:12345-0@lo:400:kworker.0 Request processed in 37us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607615.556532:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1782607615.556569:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580c07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1869199364374144:0@lo:400:kworker.0 00010000:00080000:3.0:1782607615.556580:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974580c04a80 x1869199364374016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607615.556590:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580c04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364374016:0@lo:400:kworker.0 00000100:00100000:3.0:1782607615.556627:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457ff1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1869199364373888:0@lo:400:kworker.0 00010000:00080000:3.0:1782607615.556636:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974580c05c00 x1869199364374272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607615.556650:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580c05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364374272:0@lo:400:kworker.0 00000100:00100000:2.0:1782607615.557341:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580c07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869199364373760:12345-0@lo:400:kworker.0 Request processed in 1334us (1647us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607615.557349:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1782607615.557380:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782607615.557384:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782607615.557387:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782607615.557535:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457ff1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869199364373760:0@lo:400:kworker.0 00000100:00100000:0.0:1782607615.557797:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364373632 00000100:00100000:0.0:1782607615.557804:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364373632 00000100:00100000:0.0:1782607615.557839:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1782607615.557849:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3319:x1869199364373632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607615.557901:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3319:x1869199364373632:12345-0@lo:400:kworker.0 Request processed in 54us (2589us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607615.557908:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1782607615.558713:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457ff1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364373632:0@lo:400:kworker.0 00000100:00100000:3.0:1782607616.068975:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782607616.069005:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364374400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782607616.069077:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607616.069155:0:6613:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364374400 00000100:00100000:1.0:1782607616.069165:0:6613:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364374400 00000100:00100000:1.0:1782607616.069340:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782607616.069351:0:6613:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364374400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782607616.069390:0:6613:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782607616.069449:0:6613:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364374400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607616.069457:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1782607616.069475:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9745676c8700 x1869199364374400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607632 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607616.069495:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364374400:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782607616.194619:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1782607616.633171:0:7525:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5d45e125-365f-42d9-9f91-770009f5d4b0 00000020:00000080:3.0:1782607616.633184:0:7525:0:(genops.c:906:class_export_put()) final put ffff974580f24000/5d45e125-365f-42d9-9f91-770009f5d4b0 00000020:00000080:2.0:1782607616.637806:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff974580f24000/5d45e125-365f-42d9-9f91-770009f5d4b0 for lustre-OST0001 00000020:00000080:2.0:1782607616.637869:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff974580f24800 for lustre-OST0001 00000100:00100000:0.0:1782607617.090090:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782607617.090116:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364374528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782607617.090185:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607617.090363:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364374528 00000100:00100000:3.0:1782607617.090372:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364374528 00000100:00100000:3.0:1782607617.092915:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782607617.092932:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745509ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364374528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782607617.092975:0:6612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782607617.093074:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745509ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364374528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 148us (2889us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607617.093083:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1782607617.093122:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9745676c8380 x1869199364374528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607633 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607617.093144:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364374528:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782607617.097122:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782607617.218025:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607618.242013:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1782607619.213479:0:6634:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5d45e125-365f-42d9-9f91-770009f5d4b0 00000020:00000080:1.0:1782607619.213488:0:6634:0:(genops.c:906:class_export_put()) final put ffff974580f27800/5d45e125-365f-42d9-9f91-770009f5d4b0 00000020:00000080:3.0:1782607619.213615:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff974580f27800/5d45e125-365f-42d9-9f91-770009f5d4b0 for lustre-OST0000 00000020:00000080:3.0:1782607619.213667:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff974580f26800 for lustre-OST0000 00010000:00010000:3.0:1782607619.266994:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782607619.527486:0:10900:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1782607620.293885:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607620.330608:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607620.330657:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607620.331155:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342319744 00000100:00100000:3.0:1782607620.331166:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342319744 00000100:00100000:1.0:1782607620.331208:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607620.331222:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 227 00000100:00100000:3.0:1782607620.331234:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2355:x1869199342319744:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1782607620.331327:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2355:x1869199342319744:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 95us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607620.331334:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 227 00000100:00100000:2.0:1782607620.353879:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342320000 00000100:00100000:2.0:1782607620.353896:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342320000 00000100:00100000:2.0:1782607620.354049:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342319872 00000100:00100000:2.0:1782607620.354054:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342319872 00000100:00100000:2.0:1782607620.354104:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 86 00000100:00100000:2.0:1782607620.354115:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2355:x1869199342320000:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607620.354206:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2355:x1869199342320000:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 93us (23548us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607620.354214:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 86 00000100:00100000:2.0:1782607620.354233:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 87 00000100:00100000:2.0:1782607620.354240:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2355:x1869199342319872:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607620.354302:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2355:x1869199342319872:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 62us (23095us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607620.354309:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 87 00000100:00080000:0.0:1782607620.354676:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782607620.682610:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869199364374784:0@lo:400:kworker.0 00000100:00100000:0.0:1782607620.682693:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607620.682751:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364375296:0@lo:400:kworker.0 00000100:00100000:0.0:1782607620.682796:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607620.682830:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782607620.682836:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1869199364374912:0@lo:400:kworker.0 00000100:00100000:0.0:1782607620.682877:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607620.682912:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364374784 00000100:00100000:0.0:1782607620.682920:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364374784 00000100:00100000:0.0:1782607620.682979:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364374912 00000100:00100000:0.0:1782607620.682983:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364374912 00000100:00100000:0.0:1782607620.683044:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1782607620.683057:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869199364374784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607620.683115:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869199364374784:12345-0@lo:400:kworker.0 Request processed in 61us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607620.683123:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1782607620.683144:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1782607620.683151:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869199364374912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607620.683184:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869199364374912:12345-0@lo:400:kworker.0 Request processed in 34us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607620.683190:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1782607620.683216:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364375296 00000100:00100000:0.0:1782607620.683221:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364375296 00000100:00100000:0.0:1782607620.683256:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1782607620.683264:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364375296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607620.683297:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364375296:12345-0@lo:400:kworker.0 Request processed in 33us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607620.683303:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1782607620.683328:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782607620.683332:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782607620.683442:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364374656:0@lo:400:kworker.0 00000100:00100000:1.0:1782607620.683478:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607620.683500:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1869199364375168:0@lo:400:kworker.0 00000100:00100000:1.0:1782607620.683522:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607620.683586:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364375040:0@lo:400:kworker.0 00000100:00100000:2.0:1782607620.683615:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607620.683755:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364375168 00000100:00100000:2.0:1782607620.683760:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364375168 00000100:00100000:2.0:1782607620.683829:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1782607620.683836:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1869199364375168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607620.683887:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1869199364375168:12345-0@lo:400:kworker.0 Request processed in 52us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607620.683894:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1782607620.683914:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364374656 00000100:00100000:2.0:1782607620.683917:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364374656 00000100:00100000:2.0:1782607620.683941:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1782607620.683947:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3319:x1869199364374656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607620.684449:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364375040 00000100:00100000:0.0:1782607620.684455:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364375040 00000100:00100000:0.0:1782607620.684537:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782607620.684548:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364375040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607620.684740:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364375040:12345-0@lo:400:kworker.0 Request processed in 194us (1123us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607620.684748:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1782607620.684788:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782607620.684792:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782607620.684828:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1869199364374912:0@lo:400:kworker.0 00000100:00100000:0.0:1782607620.684846:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869199364374784:0@lo:400:kworker.0 00010000:00080000:0.0:1782607620.684859:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9745509ef100 x1869199364375296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782607620.684870:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364375296:0@lo:400:kworker.0 00000100:00100000:2.0:1782607620.684952:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3319:x1869199364374656:12345-0@lo:400:kworker.0 Request processed in 1004us (1472us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607620.684960:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1782607620.685014:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364374656:0@lo:400:kworker.0 00000100:00100000:2.0:1782607620.685026:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1869199364375168:0@lo:400:kworker.0 00010000:00080000:1.0:1782607620.685113:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9745509edc00 x1869199364375040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607620.685123:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364375040:0@lo:400:kworker.0 00000100:00100000:1.0:1782607621.191382:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364375424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782607621.191485:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607621.191596:0:6613:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364375424 00000100:00100000:1.0:1782607621.191607:0:6613:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364375424 00000100:00100000:1.0:1782607621.191668:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782607621.191678:0:6613:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364375424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782607621.191727:0:6613:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782607621.191798:0:6613:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364375424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607621.191805:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1782607621.191857:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9745676cbb80 x1869199364375424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607637 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607621.191879:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364375424:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782607621.315389:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607622.219387:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364375552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782607622.219498:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607622.219610:0:6613:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364375552 00000100:00100000:1.0:1782607622.219620:0:6613:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364375552 00000100:00100000:1.0:1782607622.219703:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1782607622.219717:0:6613:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364375552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782607622.219807:0:6613:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782607622.219863:0:6613:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364375552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607622.219872:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1782607622.219902:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782607622.219947:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974581266680 x1869199364375552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607638 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607622.219987:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364375552:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782607622.339832:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607623.370739:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782607623.421970:0:11048:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc11ce4a30 20000000:00000080:2.0:1782607623.421997:0:11048:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97457fbe7400 uarg=0000000000000000 20000000:01000000:2.0:1782607623.422051:0:11048:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1782607623.422066:0:11048:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1782607623.422073:0:11048:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1782607623.423179:0:11049:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1782607623.423406:0:11048:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1782607623.428917:0:11048:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1782607623.428959:0:11048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9745585ac600/0x8109266df35cb1f7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607623.428986:0:11048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff974546c42800/0x8109266df35cb19c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffbfa expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607623.428997:0:11048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9745821d1200/0x8109266df35cb1aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cb1a3 expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607623.429006:0:11048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9745585ad000/0x8109266df35cb1b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cb1b1 expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607623.429012:0:11048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9745821d0400/0x8109266df35cb1c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cb1bf expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607623.429019:0:11048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9745585acc00/0x8109266df35cb1db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc32 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607623.429028:0:11048:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9745585ac600/0x8109266df35cb1f7 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607623.429084:0:11048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9745585acc00/0x8109266df35cb1db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc32 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607623.429102:0:11048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9745585acc00/0x8109266df35cb1db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc32 expref: 12 pid: 5798 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607623.429120:0:11048:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745508c9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11048:1869199364375680:192.168.202.4@tcp:104: 00010000:00010000:2.0:1782607623.429285:0:11048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9745821d0400/0x8109266df35cb1c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8109266df35cb1bf expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607623.429294:0:11048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9745821d0400/0x8109266df35cb1c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8109266df35cb1bf expref: 18 pid: 5798 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607623.429304:0:11048:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745508ca300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11048:1869199364375808:0@lo:104: 00000100:00100000:2.0:1782607623.429350:0:11048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782607623.429391:0:11048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9745585ad000/0x8109266df35cb1b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8109266df35cb1b1 expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607623.429399:0:11048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9745585ad000/0x8109266df35cb1b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8109266df35cb1b1 expref: 18 pid: 5795 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607623.429407:0:11048:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580e52680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11048:1869199364375936:0@lo:104: 00000100:00100000:2.0:1782607623.429424:0:11048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782607623.429439:0:11048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9745821d1200/0x8109266df35cb1aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8109266df35cb1a3 expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607623.429446:0:11048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9745821d1200/0x8109266df35cb1aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8109266df35cb1a3 expref: 18 pid: 5795 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607623.429454:0:11048:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580e50a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11048:1869199364376064:0@lo:104: 00000100:00100000:2.0:1782607623.429469:0:11048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782607623.429481:0:11048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff974546c42800/0x8109266df35cb19c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffbfa expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607623.429489:0:11048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff974546c42800/0x8109266df35cb19c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffbfa expref: 12 pid: 5797 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607623.429511:0:11048:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580e52300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11048:1869199364376192:192.168.202.4@tcp:104: 00000100:00100000:2.0:1782607623.429533:0:11048:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745510dd000 going to sleep for 11 seconds 00000100:00100000:3.0:1782607623.433047:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364375808 00000100:00100000:3.0:1782607623.433071:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364375808 00000100:00100000:3.0:1782607623.433134:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364375936 00000100:00100000:3.0:1782607623.433138:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364375936 00000100:00100000:3.0:1782607623.433151:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364376064 00000100:00100000:3.0:1782607623.433154:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364376064 00000100:00100000:3.0:1782607623.433176:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782607623.433187:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+5:11048:x1869199364375808:12345-0@lo:104: 00010000:00010000:3.0:1782607623.433210:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff974546c42400/0x8109266df35cb1bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cb1c6 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607623.433362:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782607623.433370:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+5:11048:x1869199364375808:12345-0@lo:104: Request processed in 186us (4020us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607623.433378:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782607623.433398:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782607623.433405:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+4:11048:x1869199364375936:12345-0@lo:104: 00010000:00010000:3.0:1782607623.433414:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff9745585ad400/0x8109266df35cb1b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cb1b8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607623.433474:0:11048:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745508ca300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11048:1869199364375808:0@lo:104: 00010000:00010000:0.0:1782607623.433484:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782607623.433635:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974546c42400/0x8109266df35cb1bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cb1c6 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607623.433645:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42400 already unused, calling callback (ffffffffc1db0c20) 10000000:00010000:0.0:1782607623.433649:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974546c42400/0x8109266df35cb1bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8109266df35cb1c6 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607623.433660:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974546c42400/0x8109266df35cb1bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8109266df35cb1c6 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782607623.433668:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974546c42400/0x8109266df35cb1bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8109266df35cb1c6 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782607623.433674:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782607623.433736:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974546c42400/0x8109266df35cb1bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cb1c6 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607623.433744:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782607623.433799:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974546c42400/0x8109266df35cb1bf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cb1c6 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607623.433805:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974546c42400/0x8109266df35cb1bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cb1c6 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607623.433819:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607623.433821:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607623.433823:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607623.438011:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782607623.438041:0:11048:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580e52680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11048:1869199364375936:0@lo:104: 00000100:00100000:3.0:1782607623.438051:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+4:11048:x1869199364375936:12345-0@lo:104: Request processed in 4641us (8620us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607623.438068:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782607623.438121:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782607623.438136:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+3:11048:x1869199364376064:12345-0@lo:104: 00010000:00010000:3.0:1782607623.438158:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff974546c42e00/0x8109266df35cb1a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cb1aa expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607623.438271:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782607623.438277:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+3:11048:x1869199364376064:12345-0@lo:104: Request processed in 149us (8807us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607623.438283:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782607623.438321:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364376320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782607623.438379:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607623.438385:0:11048:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580e50a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11048:1869199364376064:0@lo:104: 00010000:00010000:3.0:1782607623.438442:0:7513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782607623.438462:0:7513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff9745585ad400/0x8109266df35cb1b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cb1b8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607623.438472:0:7513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ad400 already unused, calling callback (ffffffffc1db0c20) 10000000:00010000:3.0:1782607623.438477:0:7513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff9745585ad400/0x8109266df35cb1b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8109266df35cb1b8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607623.438487:0:7513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff9745585ad400/0x8109266df35cb1b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8109266df35cb1b8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782607623.438495:0:7513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff9745585ad400/0x8109266df35cb1b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8109266df35cb1b8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782607623.438502:0:7513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782607623.438668:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782607623.438676:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974546c42e00/0x8109266df35cb1a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cb1aa expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607623.438685:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42e00 already unused, calling callback (ffffffffc1db0c20) 10000000:00010000:0.0:1782607623.438688:0:5790:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974546c42e00/0x8109266df35cb1a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8109266df35cb1aa expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607623.438697:0:5790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974546c42e00/0x8109266df35cb1a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8109266df35cb1aa expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782607623.438705:0:5790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974546c42e00/0x8109266df35cb1a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8109266df35cb1aa expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782607623.438712:0:5790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782607623.438761:0:5790:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974546c42e00/0x8109266df35cb1a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cb1aa expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607623.438787:0:5790:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1782607623.438821:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364376320 00000100:00100000:2.0:1782607623.438830:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364376320 00010000:00010000:0.0:1782607623.438832:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974546c42e00/0x8109266df35cb1a3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cb1aa expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607623.438842:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974546c42e00/0x8109266df35cb1a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cb1aa expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607623.438862:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607623.438864:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607623.438868:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9745821d0400/0x8109266df35cb1c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cb1bf expref: 19 pid: 5798 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607623.438868:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607623.439055:0:7513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff9745585ad400/0x8109266df35cb1b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cb1b8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607623.439063:0:7513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782607623.439070:0:7513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff9745585ad400/0x8109266df35cb1b1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cb1b8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607623.439077:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff9745585ad400/0x8109266df35cb1b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cb1b8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607623.439100:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607623.439102:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607623.439104:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607623.439206:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fae11c6e-4506-4104-bb8c-df42498f7e08:3316:1869199364376448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782607623.439250:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607623.439290:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782607623.439297:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fae11c6e-4506-4104-bb8c-df42498f7e08:3316:1869199364376576:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782607623.439321:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607623.439359:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364376448 00000100:00100000:1.0:1782607623.439363:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364376448 00010000:00010000:1.0:1782607623.439385:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9745821d1200/0x8109266df35cb1aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cb1a3 expref: 20 pid: 5795 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607623.439406:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364376576 00000100:00100000:1.0:1782607623.439410:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364376576 00010000:00010000:1.0:1782607623.439422:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9745585ad000/0x8109266df35cb1b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cb1b1 expref: 21 pid: 5795 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607623.439437:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782607623.439457:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+21:3316:x1869199364376448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782607623.439474:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782607623.439480:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9745821d1200/0x8109266df35cb1aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cb1a3 expref: 21 pid: 5795 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607623.439491:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9745821d1200/0x8109266df35cb1aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8109266df35cb1a3 expref: 21 pid: 5795 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607623.439518:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9745821d1200/0x8109266df35cb1aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8109266df35cb1a3 expref: 21 pid: 5795 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607623.439560:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782607623.439596:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+20:3316:x1869199364376448:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607623.439603:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782607623.439619:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782607623.439626:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3316:x1869199364376576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782607623.439635:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782607623.439639:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9745585ad000/0x8109266df35cb1b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cb1b1 expref: 19 pid: 5795 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607623.439648:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9745585ad000/0x8109266df35cb1b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8109266df35cb1b1 expref: 19 pid: 5795 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607623.439659:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9745585ad000/0x8109266df35cb1b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8109266df35cb1b1 expref: 19 pid: 5795 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607623.439669:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782607623.439691:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+18:3316:x1869199364376576:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607623.439698:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782607623.439732:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fae11c6e-4506-4104-bb8c-df42498f7e08:3316:1869199364376576:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782607623.439741:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fae11c6e-4506-4104-bb8c-df42498f7e08:3316:1869199364376448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782607623.440865:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782607623.440892:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974548807c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fae11c6e-4506-4104-bb8c-df42498f7e08+17:3319:x1869199364376320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782607623.440908:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782607623.440915:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9745821d0400/0x8109266df35cb1c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cb1bf expref: 17 pid: 5798 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607623.440927:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9745821d0400/0x8109266df35cb1c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8109266df35cb1bf expref: 17 pid: 5798 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607623.440941:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9745821d0400/0x8109266df35cb1c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8109266df35cb1bf expref: 17 pid: 5798 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607623.440955:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782607623.441013:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974548807c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fae11c6e-4506-4104-bb8c-df42498f7e08+16:3319:x1869199364376320:12345-0@lo:103:ldlm_bl.0 Request processed in 129us (2636us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607623.441128:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782607623.441534:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364376320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782607623.442421:0:11048:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745508c9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11048:1869199364375680:192.168.202.4@tcp:104: 00000100:00100000:3.0:1782607623.443756:0:11048:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580e52300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11048:1869199364376192:192.168.202.4@tcp:104: 00010000:00010000:3.0:1782607623.443850:0:11048:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9745585ac600/0x8109266df35cb1f7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607623.446074:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607623.446170:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607623.446320:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342320128 00000100:00100000:3.0:1782607623.446333:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342320128 00010000:00010000:3.0:1782607623.446611:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9745585acc00/0x8109266df35cb1db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc32 expref: 13 pid: 5798 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607623.446659:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342320256 00000100:00100000:3.0:1782607623.446663:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342320256 00010000:00010000:3.0:1782607623.446677:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff974546c42800/0x8109266df35cb19c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffbfa expref: 14 pid: 5797 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607623.446693:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 28 00000100:00100000:3.0:1782607623.446825:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+14:2357:x1869199342320128:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782607623.446846:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782607623.446852:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9745585acc00/0x8109266df35cb1db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc32 expref: 14 pid: 5798 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607623.446866:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9745585acc00/0x8109266df35cb1db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc32 expref: 14 pid: 5798 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607623.446889:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9745585acc00/0x8109266df35cb1db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc32 expref: 14 pid: 5798 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607623.446906:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782607623.446979:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2357:x1869199342320128:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 156us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607623.446988:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 28 00000100:00100000:3.0:1782607623.447007:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 29 00000100:00100000:3.0:1782607623.447013:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+12:2356:x1869199342320256:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782607623.447021:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782607623.447025:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff974546c42800/0x8109266df35cb19c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffbfa expref: 12 pid: 5797 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607623.447035:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff974546c42800/0x8109266df35cb19c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffbfa expref: 12 pid: 5797 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607623.447045:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974546c42800/0x8109266df35cb19c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffbfa expref: 12 pid: 5797 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607623.447057:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9745585ac600/0x8109266df35cb1f7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607623.447074:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9745585ac600/0x8109266df35cb1f7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607623.447095:0:5788:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9745585ac600/0x8109266df35cb1f7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607623.447104:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9745585ac600/0x8109266df35cb1f7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607623.447111:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9745585ac600/0x8109266df35cb1f7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607623.447119:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9745585ac600/0x8109266df35cb1f7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607623.447126:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ac600 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:3.0:1782607623.447131:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9745585ac600/0x8109266df35cb1f7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607623.447141:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9745585ac600/0x8109266df35cb1f7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607623.447162:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9745585ac600/0x8109266df35cb1f7 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607623.447175:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782607623.447195:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+11:2356:x1869199342320256:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 182us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607623.447202:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 29 00010000:00010000:3.0:1782607623.447237:0:11048:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9745585ac600/0x8109266df35cb1f7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607623.447253:0:11048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9745585ac600/0x8109266df35cb1f7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607623.447260:0:11048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9745585ac600/0x8109266df35cb1f7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607624.407152:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782607624.833850:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782607624.833858:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff97457f5e0000 from 7 10000000:01000000:0.0:1782607624.833864:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782607624.833912:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974546c43000/0x8109266df35cb1fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607624.833925:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974546c43000/0x8109266df35cb1fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607624.833938:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974546c43000/0x8109266df35cb1fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607624.833965:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581266d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364376704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782607624.834045:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607624.834104:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745712a9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782607624.834122:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364376704 00000100:00100000:3.0:1782607624.834130:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364376704 00000100:00100000:3.0:1782607624.834226:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1782607624.834236:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+16:5800:x1869199364376704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782607624.834250:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607624.834262:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97455d648200/0x8109266df35cb205 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cb1fe expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607624.834286:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97455d648200/0x8109266df35cb205 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cb1fe expref: 17 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607624.834297:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97455d648200/0x8109266df35cb205 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cb1fe expref: 17 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607624.834306:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97455d648200, rc 0) 00000100:00100000:3.0:1782607624.834356:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+17:5800:x1869199364376704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607624.834363:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1782607624.834451:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581266d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364376704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782607624.834473:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974546c43000/0x8109266df35cb1fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb205 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607624.834484:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974546c43000/0x8109266df35cb1fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cb205 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607624.834563:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581008a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364376832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782607624.834599:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607624.837956:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff97458124aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1782607624.840638:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364376832 00000100:00100000:0.0:1782607624.840654:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364376832 00000100:00100000:0.0:1782607624.841148:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1782607624.841159:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+17:5800:x1869199364376832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782607624.841677:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+17:5800:x1869199364376832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 519us (7075us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607624.841782:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1782607624.842162:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581008a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364376832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782607624.842224:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581267480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364376960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782607624.842275:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607624.842312:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745712a9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782607624.842328:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364376960 00000100:00100000:0.0:1782607624.842334:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364376960 00000100:00100000:0.0:1782607624.842360:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1782607624.842367:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+17:5800:x1869199364376960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782607624.843241:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+17:5800:x1869199364376960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 870us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607624.843250:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1782607624.843305:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581267480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364376960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782607624.846256:0:11099:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1782607624.846345:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1782607624.846368:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782607624.846382:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974546c43000/0x8109266df35cb1fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb205 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607624.846394:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974546c43000/0x8109266df35cb1fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb205 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782607624.846405:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782607624.846408:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff97455053f000 from 7 10000000:01000000:0.0:1782607624.846412:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782607624.847147:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974546c43c00/0x8109266df35cb20c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607624.847165:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974546c43c00/0x8109266df35cb20c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607624.847178:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974546c43c00/0x8109266df35cb20c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607624.847203:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581267480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364377088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782607624.847271:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607624.847309:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745712a9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782607624.847327:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364377088 00000100:00100000:0.0:1782607624.847334:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364377088 00000100:00100000:0.0:1782607624.847372:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1782607624.847380:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+17:5800:x1869199364377088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782607624.847393:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607624.847404:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974546c43800/0x8109266df35cb213 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cb20c expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607624.848194:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974546c43800/0x8109266df35cb213 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cb20c expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607624.848208:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974546c43800/0x8109266df35cb213 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cb20c expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607624.848218:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c43800, rc 0) 00000100:00100000:0.0:1782607624.848267:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+18:5800:x1869199364377088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 887us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607624.848276:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1782607624.848340:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581267480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364377088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782607624.848356:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974546c43c00/0x8109266df35cb20c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb213 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607624.848365:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974546c43c00/0x8109266df35cb20c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cb213 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607624.850119:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581267480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364377216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782607624.850205:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607624.850358:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364377216 00000100:00100000:3.0:1782607624.850366:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364377216 00000100:00100000:3.0:1782607624.850413:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1782607624.850496:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+18:5800:x1869199364377216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782607624.850662:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745712a9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782607624.852243:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+18:5800:x1869199364377216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1743us (2032us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607624.852365:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581267480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364377216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782607624.852492:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581267480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364377344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782607624.852757:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1782607624.852899:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607624.852933:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745712a9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782607624.852955:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364377344 00000100:00100000:0.0:1782607624.852961:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364377344 00000100:00100000:0.0:1782607624.852999:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1782607624.853006:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+18:5800:x1869199364377344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782607624.854005:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+18:5800:x1869199364377344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 994us (1102us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607624.854017:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1782607624.854059:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581267480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364377344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782607624.862205:0:11100:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1782607624.863120:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1782607624.863150:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782607624.863164:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974546c43c00/0x8109266df35cb20c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb213 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607624.863190:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974546c43c00/0x8109266df35cb20c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb213 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782607624.863201:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782607624.863205:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff974544151000 from 7 10000000:01000000:0.0:1782607624.863208:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782607624.864155:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974546c43600/0x8109266df35cb21a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607624.864171:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974546c43600/0x8109266df35cb21a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607624.864185:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974546c43600/0x8109266df35cb21a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607624.864214:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581266680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364377472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782607624.864296:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607624.864332:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745712a9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782607624.864915:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364377472 00000100:00100000:3.0:1782607624.864925:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364377472 00000100:00100000:3.0:1782607624.864980:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1782607624.864991:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+18:5800:x1869199364377472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782607624.865008:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607624.865024:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97455d649200/0x8109266df35cb221 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cb21a expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607624.865518:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97455d649200/0x8109266df35cb221 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cb21a expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607624.865529:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97455d649200/0x8109266df35cb221 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cb21a expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607624.865550:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97455d649200, rc 0) 00000100:00100000:3.0:1782607624.866522:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+19:5800:x1869199364377472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1529us (2222us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607624.866549:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1782607624.867022:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581266680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364377472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782607624.867189:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974546c43600/0x8109266df35cb21a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb221 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607624.867201:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974546c43600/0x8109266df35cb21a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cb221 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607624.868098:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581266680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364377600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782607624.868154:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607624.868198:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745712a9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782607624.868219:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364377600 00000100:00100000:0.0:1782607624.868224:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364377600 00000100:00100000:0.0:1782607624.868280:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1782607624.868289:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+19:5800:x1869199364377600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782607624.872776:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+19:5800:x1869199364377600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3300us (3434us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607624.873091:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1782607624.873193:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581266680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364377600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782607624.873255:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581266680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364377728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782607624.873318:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607624.873349:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745712a9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782607624.873863:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364377728 00000100:00100000:3.0:1782607624.873871:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364377728 00000100:00100000:3.0:1782607624.873916:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1782607624.873924:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+19:5800:x1869199364377728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782607624.874340:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+19:5800:x1869199364377728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 415us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607624.874357:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1782607624.876126:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607624.876160:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342320384 00000100:00100000:0.0:1782607624.876169:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342320384 00000100:00100000:0.0:1782607624.876214:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 238 00000100:00100000:0.0:1782607624.876223:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+11:5571:x1869199342320384:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782607624.876239:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607624.876257:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974546c43400/0x8109266df35cb228 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffc5c expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607624.876284:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974546c43400/0x8109266df35cb228 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc5c expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607624.876296:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974546c43400/0x8109266df35cb228 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc5c expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607624.876318:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c43400, rc 0) 00000100:00100000:0.0:1782607624.878119:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+12:5571:x1869199342320384:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 1458us (1562us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607624.878130:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 238 00000100:00100000:0.0:1782607624.878327:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581266680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364377728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782607624.881785:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000040:00080000:3.0:1782607624.882363:0:11104:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000100:00100000:0.0:1782607624.882451:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342320512 00000100:00100000:0.0:1782607624.882460:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342320512 00000100:00100000:0.0:1782607624.882510:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 239 00000100:00100000:0.0:1782607624.882519:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+12:5571:x1869199342320512:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782607624.886428:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+12:5571:x1869199342320512:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 Request processed in 3899us (4662us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607624.886444:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 239 00000020:01000000:0.0:1782607624.886740:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1782607624.886993:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782607624.887004:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974546c43600/0x8109266df35cb21a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb221 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607624.887017:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974546c43600/0x8109266df35cb21a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb221 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607624.890071:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607624.890113:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342320640 00000100:00100000:1.0:1782607624.890124:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342320640 00000100:00100000:1.0:1782607624.890178:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 240 00000100:00100000:1.0:1782607624.890186:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+12:5571:x1869199342320640:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782607624.890389:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+12:5571:x1869199342320640:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 Request processed in 203us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607624.890397:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 240 00000100:00100000:3.0:1782607624.901064:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607624.901102:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342320768 00000100:00100000:3.0:1782607624.901113:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342320768 00000100:00100000:3.0:1782607624.901200:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 241 00000100:00100000:3.0:1782607624.901210:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+12:5571:x1869199342320768:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782607624.901228:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607624.901246:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97455d648e00/0x8109266df35cb22f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffc63 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607624.901276:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97455d648e00/0x8109266df35cb22f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc63 expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607624.901286:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97455d648e00/0x8109266df35cb22f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc63 expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607624.901294:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97455d648e00, rc 0) 00000100:00100000:3.0:1782607624.901350:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:5571:x1869199342320768:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 141us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607624.901357:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 241 00000100:00100000:1.0:1782607624.905343:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607624.905381:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342320896 00000100:00100000:1.0:1782607624.905391:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342320896 00000100:00100000:1.0:1782607624.905438:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 242 00000100:00100000:1.0:1782607624.905447:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:5571:x1869199342320896:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782607624.906529:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:5571:x1869199342320896:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 Request processed in 1077us (1190us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607624.906563:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 242 00000100:00100000:0.0:1782607624.916436:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607624.916510:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342321024 00000100:00100000:2.0:1782607624.916521:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342321024 00000100:00100000:2.0:1782607624.916606:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 243 00000100:00100000:2.0:1782607624.916616:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:5571:x1869199342321024:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782607624.916880:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:5571:x1869199342321024:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 Request processed in 264us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607624.916888:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 243 00010000:00010000:0.0:1782607625.412461:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782607625.451158:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607625.451202:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607625.451225:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607625.451262:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342321408 00000100:00100000:2.0:1782607625.451271:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342321408 00000100:00100000:2.0:1782607625.451331:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342321280 00000100:00100000:2.0:1782607625.451334:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342321280 00000100:00100000:2.0:1782607625.451356:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 91 00000100:00100000:2.0:1782607625.451367:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580e50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2354:x1869199342321408:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607625.451455:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580e50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2354:x1869199342321408:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 90us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607625.451463:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 91 00000100:00100000:2.0:1782607625.451479:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 92 00000100:00100000:2.0:1782607625.451486:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580e53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2354:x1869199342321280:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607625.451509:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580e53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2354:x1869199342321280:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 24us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607625.451515:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 92 00000100:00100000:3.0:1782607625.451570:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342321152 00000100:00100000:3.0:1782607625.451574:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342321152 00000100:00100000:3.0:1782607625.451609:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 244 00000100:00100000:3.0:1782607625.451617:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2354:x1869199342321152:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1782607625.451643:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2354:x1869199342321152:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 28us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607625.451664:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 244 00000100:00080000:1.0:1782607625.452582:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782607625.802932:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581009180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1869199364377984:0@lo:400:kworker.0 00000100:00100000:1.0:1782607625.803250:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607625.803305:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97458100b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364378496:0@lo:400:kworker.0 00000100:00100000:1.0:1782607625.803333:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607625.803370:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1782607625.803377:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364377856:0@lo:400:kworker.0 00000100:00100000:1.0:1782607625.803568:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607625.803592:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97458100aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1869199364378368:0@lo:400:kworker.0 00000100:00100000:1.0:1782607625.803613:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607625.803646:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97458100a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1869199364378112:0@lo:400:kworker.0 00000100:00100000:1.0:1782607625.803671:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607625.803695:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782607625.803701:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364378240:0@lo:400:kworker.0 00000100:00100000:1.0:1782607625.803719:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607625.803752:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364377984 00000100:00100000:1.0:1782607625.803760:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364377984 00000100:00100000:1.0:1782607625.803855:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364378368 00000100:00100000:1.0:1782607625.803859:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364378368 00000100:00100000:1.0:1782607625.803879:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364378112 00000100:00100000:1.0:1782607625.803882:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364378112 00000100:00100000:1.0:1782607625.803895:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1782607625.803903:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458100a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1869199364377984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607625.803954:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458100a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1869199364377984:12345-0@lo:400:kworker.0 Request processed in 51us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607625.803973:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1782607625.804126:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1782607625.804135:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1869199364378368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607625.804165:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1869199364378368:12345-0@lo:400:kworker.0 Request processed in 32us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607625.804172:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1782607625.804183:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1782607625.804189:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458100bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869199364378112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607625.804222:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458100bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869199364378112:12345-0@lo:400:kworker.0 Request processed in 33us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607625.804228:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1782607625.804252:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364378496 00000100:00100000:1.0:1782607625.804256:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364378496 00000100:00100000:1.0:1782607625.804285:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364378240 00000100:00100000:1.0:1782607625.804289:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364378240 00000100:00100000:1.0:1782607625.804309:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1782607625.804314:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364378496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607625.804343:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364378496:12345-0@lo:400:kworker.0 Request processed in 29us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607625.804350:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1782607625.804360:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1782607625.804366:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364378240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607625.804405:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364378240:12345-0@lo:400:kworker.0 Request processed in 39us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607625.804672:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1782607625.804700:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364377856 00000100:00100000:1.0:1782607625.804704:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364377856 00000100:00100000:1.0:1782607625.804728:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1782607625.804733:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3319:x1869199364377856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607625.804761:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3319:x1869199364377856:12345-0@lo:400:kworker.0 Request processed in 28us (1194us total) trans 0 rc 0/0 00000100:00080000:0.0:1782607625.804820:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782607625.804825:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782607625.804833:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782607625.804914:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1782607625.804957:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364377856:0@lo:400:kworker.0 00000100:00100000:1.0:1782607625.804971:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97458100aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1869199364378368:0@lo:400:kworker.0 00000100:00100000:1.0:1782607625.804992:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581009180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1869199364377984:0@lo:400:kworker.0 00010000:00080000:1.0:1782607625.805009:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97458100b100 x1869199364378496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607625.805018:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97458100b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364378496:0@lo:400:kworker.0 00010000:00080000:1.0:1782607625.805297:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974581009880 x1869199364378240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607625.805307:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364378240:0@lo:400:kworker.0 00000100:00100000:1.0:1782607625.805318:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97458100a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1869199364378112:0@lo:400:kworker.0 00000100:00100000:0.0:1782607626.306290:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782607626.306316:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364378624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782607626.306429:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607626.306510:0:6613:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364378624 00000100:00100000:0.0:1782607626.306517:0:6613:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364378624 00000100:00100000:0.0:1782607626.306576:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1782607626.306585:0:6613:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364378624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782607626.306621:0:6613:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782607626.306801:0:6613:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364378624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 217us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607626.306809:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1782607626.306858:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974581266680 x1869199364378624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607642 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782607626.306878:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364378624:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782607626.440401:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607627.333889:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364378752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782607627.333961:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607627.334176:0:6613:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364378752 00000100:00100000:0.0:1782607627.334185:0:6613:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364378752 00000100:00100000:0.0:1782607627.334249:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1782607627.334259:0:6613:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458100a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364378752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782607627.334296:0:6613:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782607627.334342:0:6613:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458100a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364378752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607627.334350:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1782607627.334392:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974581266680 x1869199364378752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607643 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1782607627.334478:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782607627.334531:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364378752:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782607627.459477:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782607628.050742:0:11246:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1782607628.496992:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607629.506301:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607630.532956:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782607630.584395:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607630.584451:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607630.584480:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607630.584659:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342321792 00000100:00100000:1.0:1782607630.584675:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342321792 00000100:00100000:1.0:1782607630.584788:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342321664 00000100:00100000:1.0:1782607630.584792:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342321664 00000100:00100000:1.0:1782607630.584836:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 96 00000100:00100000:1.0:1782607630.584849:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580e52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2357:x1869199342321792:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1782607630.584956:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580e52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2357:x1869199342321792:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 110us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607630.584963:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 96 00000100:00100000:1.0:1782607630.584994:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 97 00000100:00100000:1.0:1782607630.585001:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580e50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2357:x1869199342321664:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1782607630.585026:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580e50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2357:x1869199342321664:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 26us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607630.585032:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 97 00000100:00080000:2.0:1782607630.585730:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782607630.585820:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342321536 00000100:00100000:0.0:1782607630.585828:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342321536 00000100:00100000:0.0:1782607630.585892:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 246 00000100:00100000:0.0:1782607630.585901:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2357:x1869199342321536:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1782607630.585958:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2357:x1869199342321536:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 59us (1578us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607630.585977:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 246 00000100:00100000:0.0:1782607630.914270:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1869199364379136:0@lo:400:kworker.0 00000100:00100000:0.0:1782607630.914347:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607630.914399:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782607630.914405:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364379264:0@lo:400:kworker.0 00000100:00100000:0.0:1782607630.914426:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607630.914483:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1869199364379008:0@lo:400:kworker.0 00000100:00100000:2.0:1782607630.914519:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607630.914541:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364379520:0@lo:400:kworker.0 00000100:00100000:2.0:1782607630.914561:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607630.914582:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1782607630.914587:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364378880:0@lo:400:kworker.0 00000100:00100000:2.0:1782607630.914609:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607630.914625:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1869199364379392:0@lo:400:kworker.0 00000100:00100000:2.0:1782607630.914640:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607630.914664:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364379264 00000100:00100000:2.0:1782607630.914671:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364379264 00000100:00100000:2.0:1782607630.914721:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364379520 00000100:00100000:2.0:1782607630.914724:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364379520 00000100:00100000:2.0:1782607630.914751:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782607630.914760:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745509ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364379264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607630.915047:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745509ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364379264:12345-0@lo:400:kworker.0 Request processed in 287us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607630.915055:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782607630.915072:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782607630.915078:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974551141880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364379520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607630.915102:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974551141880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364379520:12345-0@lo:400:kworker.0 Request processed in 26us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607630.915121:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782607630.915137:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364379136 00000100:00100000:2.0:1782607630.915140:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364379136 00000100:00100000:2.0:1782607630.915162:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364379008 00000100:00100000:2.0:1782607630.915164:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364379008 00000100:00100000:2.0:1782607630.915172:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364379392 00000100:00100000:2.0:1782607630.915174:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364379392 00000100:00100000:2.0:1782607630.915184:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1782607630.915189:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745509efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869199364379136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607630.915215:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745509efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869199364379136:12345-0@lo:400:kworker.0 Request processed in 25us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607630.915220:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1782607630.915229:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1782607630.915233:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580e52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1869199364379008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607630.915251:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580e52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1869199364379008:12345-0@lo:400:kworker.0 Request processed in 18us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607630.915257:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1782607630.915264:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1782607630.915269:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974551142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1869199364379392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607630.915287:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974551142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1869199364379392:12345-0@lo:400:kworker.0 Request processed in 18us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607630.915292:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:2.0:1782607630.915304:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782607630.915309:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782607630.915311:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782607630.915336:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1869199364379392:0@lo:400:kworker.0 00000100:00100000:2.0:1782607630.915354:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1869199364379008:0@lo:400:kworker.0 00010000:00080000:2.0:1782607630.915364:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9745509ef100 x1869199364379520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782607630.915374:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364379520:0@lo:400:kworker.0 00010000:00080000:2.0:1782607630.915400:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9745509ec380 x1869199364379264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782607630.915408:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364379264:0@lo:400:kworker.0 00000100:00100000:2.0:1782607630.915416:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1869199364379136:0@lo:400:kworker.0 00000100:00100000:1.0:1782607630.915505:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364378880 00000100:00100000:1.0:1782607630.915509:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364378880 00000100:00100000:1.0:1782607630.915539:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1782607630.915545:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3319:x1869199364378880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607630.915579:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3319:x1869199364378880:12345-0@lo:400:kworker.0 Request processed in 34us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607630.915584:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1782607630.915617:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364378880:0@lo:400:kworker.0 00000100:00100000:1.0:1782607631.426333:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782607631.426372:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364379648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782607631.426459:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607631.426657:0:6613:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364379648 00000100:00100000:0.0:1782607631.426668:0:6613:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364379648 00000100:00100000:0.0:1782607631.426729:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1782607631.426739:0:6613:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581009880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364379648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782607631.426800:0:6613:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782607631.426866:0:6613:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581009880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364379648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607631.426873:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1782607631.427096:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9745509edc00 x1869199364379648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607647 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607631.427116:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364379648:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782607631.554008:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782607632.451132:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782607632.451167:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364379776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782607632.451264:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607632.451430:0:6613:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364379776 00000100:00100000:0.0:1782607632.451442:0:6613:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364379776 00000100:00100000:0.0:1782607632.451533:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1782607632.451545:0:6613:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974551143100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364379776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782607632.451595:0:6613:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782607632.451652:0:6613:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974551143100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364379776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607632.451676:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1782607632.451722:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9745509ec380 x1869199364379776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607648 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782607632.451743:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364379776:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782607632.451939:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782607632.582669:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782607632.642327:0:11346:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 20:47:11 (1782607631) === 00000100:00100000:2.0:1782607632.951547:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607632.951625:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607632.951807:0:5812:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342322048 00000100:00100000:1.0:1782607632.951832:0:5812:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342322048 00000100:00100000:1.0:1782607632.951925:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 0 00000100:00100000:1.0:1782607632.951942:0:5812:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974551140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:9669:x1869199342322048:12345-192.168.202.4@tcp:700:mkdir.0 00000100:00100000:1.0:1782607632.952228:0:5812:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974551140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:9669:x1869199342322048:12345-192.168.202.4@tcp:700:mkdir.0 Request processed in 289us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607632.952238:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 0 00000100:00100000:0.0:1782607632.952356:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342321920 00000100:00100000:0.0:1782607632.952362:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342321920 00000100:00100000:0.0:1782607632.952430:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 14 00000100:00100000:0.0:1782607632.952441:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974551143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2357:x1869199342321920:12345-192.168.202.4@tcp:41:mkdir.0 00000004:00000024:0.0:1782607632.952496:0:5803:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:2.0:1782607632.953157:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782607632.953976:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974551143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2357:x1869199342321920:12345-192.168.202.4@tcp:41:mkdir.0 Request processed in 1003us (1913us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607632.953992:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 14 00000100:00100000:2.0:1782607632.956185:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607632.956312:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342322304 00000100:00100000:1.0:1782607632.956326:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342322304 00000100:00100000:1.0:1782607632.956519:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15 00000100:00100000:1.0:1782607632.956532:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974551141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:9669:x1869199342322304:12345-192.168.202.4@tcp:36:mkdir.0 00010000:00010000:1.0:1782607632.956619:0:7437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782607632.956879:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cb117 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffbe5 expref: 6 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607632.956915:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97454c8e3b00) 00010000:00010000:1.0:1782607632.956946:0:7437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782607632.957416:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb236 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607632.957434:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb236 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607632.957445:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb236 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607632.957572:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466600/0x8109266df35cb23d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607632.957582:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466600/0x8109266df35cb23d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607632.957589:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466600/0x8109266df35cb23d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782607632.968251:0:7437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:1.0:1782607632.968279:0:7437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb236 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607632.968294:0:7437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb236 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607632.968302:0:7437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb236 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607632.968309:0:7437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f466400 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607632.968314:0:7437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb236 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607632.968322:0:7437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb236 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607632.968340:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff974543e77f00) 00010000:00010000:1.0:1782607632.968344:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607632.968348:0:7437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb236 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607632.968355:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb236 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782607632.968380:0:7437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002c3c0e5b reply state 00000000647a64a6 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466600/0x8109266df35cb23d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607632.968390:0:7437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782607632.969086:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974551141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:9669:x1869199342322304:12345-192.168.202.4@tcp:36:mkdir.0 Request processed in 12551us (12911us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1782607632.969114:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15 00010000:00010000:0.0:1782607632.972097:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466600/0x8109266df35cb23d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607632.972115:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466600/0x8109266df35cb23d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607632.972123:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466600/0x8109266df35cb23d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607632.972130:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f466600 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607632.972135:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466600/0x8109266df35cb23d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607632.972144:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466600/0x8109266df35cb23d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607632.972178:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff974543e77100) 00010000:00010000:0.0:1782607632.972182:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782607632.972197:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466600/0x8109266df35cb23d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607632.972203:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466600/0x8109266df35cb23d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607632.983407:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607632.983831:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342322432 00000100:00100000:1.0:1782607632.983842:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342322432 00000100:00100000:1.0:1782607632.983907:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16 00000100:00100000:1.0:1782607632.983918:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974551143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:9670:x1869199342322432:12345-192.168.202.4@tcp:101:chmod.0 00010000:00010000:1.0:1782607632.983954:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607632.983981:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb244 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffc6a expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607632.984056:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cb24b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607632.984072:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cb24b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607632.984083:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cb24b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782607632.984155:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1782607632.984159:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1782607632.984447:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cb24b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607632.984495:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb244 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc6a expref: 8 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607632.984517:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cb24b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc6a expref: 7 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607632.984546:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff974543e77f00) 00010000:00010000:1.0:1782607632.984549:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782607632.984552:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97457f466a00, rc 0) 00000100:00100000:1.0:1782607632.984623:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974551143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:9670:x1869199342322432:12345-192.168.202.4@tcp:101:chmod.0 Request processed in 707us (1224us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607632.984631:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16 00000100:00100000:2.0:1782607632.990614:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607632.992265:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342322688 00000100:00100000:0.0:1782607632.992282:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342322688 00000100:00100000:0.0:1782607632.992482:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17 00000100:00100000:0.0:1782607632.992495:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974551141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:9670:x1869199342322688:12345-192.168.202.4@tcp:36:chmod.0 00010000:00010000:0.0:1782607632.992566:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782607632.992595:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cb24b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc6a expref: 7 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607632.992616:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff974543e77f00) 00010000:00010000:0.0:1782607632.992628:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782607632.992653:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cb252 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607632.992666:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cb252 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607632.992676:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cb252 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782607632.993142:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f4578f02 reply state 00000000eb60eff9 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cb252 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607632.993164:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782607632.993181:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1782607632.993756:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974551141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+8:9670:x1869199342322688:12345-192.168.202.4@tcp:36:chmod.0 Request processed in 1261us (3150us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1782607632.993794:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17 00010000:00010000:1.0:1782607632.996314:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cb252 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607632.996333:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cb252 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607632.996340:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cb252 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607632.996347:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42a00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607632.996351:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cb252 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607632.996358:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cb252 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607632.996375:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97454c8e3e00) 00010000:00010000:1.0:1782607632.996378:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782607632.996382:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cb252 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607632.996389:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cb252 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607633.032119:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607633.032235:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342322816 00000100:00100000:0.0:1782607633.032245:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342322816 00000100:00100000:0.0:1782607633.033543:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 18 00000100:00100000:0.0:1782607633.033574:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974551140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:9671:x1869199342322816:12345-192.168.202.4@tcp:101:chown.0 00010000:00010000:0.0:1782607633.033602:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607633.033626:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cb259 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffc71 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607633.033698:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cb260 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607633.033711:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cb260 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607633.033722:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cb260 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782607633.033798:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1782607633.033802:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1782607633.033839:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cb260 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607633.033862:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cb259 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc71 expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607633.033898:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cb260 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc71 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607633.033907:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97454c8e3000) 00010000:00010000:0.0:1782607633.033909:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782607633.033912:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c43200, rc 0) 00000100:00100000:0.0:1782607633.034003:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974551140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+8:9671:x1869199342322816:12345-192.168.202.4@tcp:101:chown.0 Request processed in 448us (1895us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607633.034011:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 18 00000100:00100000:3.0:1782607633.039447:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607633.043939:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342322944 00000100:00100000:1.0:1782607633.046109:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342322944 00000100:00100000:1.0:1782607633.046198:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 19 00000100:00100000:1.0:1782607633.046209:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+8:9671:x1869199342322944:12345-192.168.202.4@tcp:101:chown.0 00010000:00010000:1.0:1782607633.046231:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607633.046254:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb267 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffc78 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.046332:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467a00/0x8109266df35cb26e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.046349:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467a00/0x8109266df35cb26e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.046437:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467a00/0x8109266df35cb26e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.046455:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cb275 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.046537:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cb275 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.046546:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cb275 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.046653:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467800/0x8109266df35cb27c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.046662:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467800/0x8109266df35cb27c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.046683:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467800/0x8109266df35cb27c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782607633.046726:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:1.0:1782607633.046730:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782607633.046756:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467800/0x8109266df35cb27c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.046790:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467a00/0x8109266df35cb26e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.046797:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467a00/0x8109266df35cb26e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.046804:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467a00/0x8109266df35cb26e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.046810:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f467a00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607633.046814:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467a00/0x8109266df35cb26e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.046821:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467a00/0x8109266df35cb26e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.046834:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97454c8e3000) 00010000:00010000:1.0:1782607633.046837:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607633.046841:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467a00/0x8109266df35cb26e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.046847:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467a00/0x8109266df35cb26e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.046872:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cb275 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.046878:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cb275 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.046885:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cb275 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.046890:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f466c00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607633.046893:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cb275 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.046899:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cb275 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.046905:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff974543e77c00) 00010000:00010000:1.0:1782607633.046907:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607633.046910:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cb275 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.046915:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cb275 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.047631:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb267 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc78 expref: 10 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.047651:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467800/0x8109266df35cb27c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc78 expref: 9 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.047672:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff974543e77a00) 00010000:00010000:1.0:1782607633.047674:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782607633.047677:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97457f467800, rc 0) 00000100:00100000:1.0:1782607633.047826:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+9:9671:x1869199342322944:12345-192.168.202.4@tcp:101:chown.0 Request processed in 1618us (8390us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607633.047834:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 19 00000100:00100000:3.0:1782607633.064296:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607633.064430:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342323200 00000100:00100000:0.0:1782607633.064441:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342323200 00000100:00100000:0.0:1782607633.064530:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 20 00000100:00100000:0.0:1782607633.064542:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+9:9671:x1869199342323200:12345-192.168.202.4@tcp:36:chown.0 00010000:00010000:0.0:1782607633.064608:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782607633.064636:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467800/0x8109266df35cb27c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc78 expref: 9 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607633.064658:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff974543e77a00) 00010000:00010000:0.0:1782607633.064670:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782607633.064698:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cb283 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607633.064712:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cb283 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607633.064722:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cb283 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782607633.140665:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:1.0:1782607633.141134:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a6331237 reply state 0000000006b6ffe2 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cb283 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607633.141169:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1782607633.141448:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:1.0:1782607633.141617:0:5804:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1782607633.141645:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:9671:x1869199342323200:12345-192.168.202.4@tcp:36:chown.0 Request processed in 77099us (77355us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1782607633.141656:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 20 00010000:00010000:0.0:1782607633.141814:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cb283 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607633.141837:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cb283 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607633.141850:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cb283 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607633.141858:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42600 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607633.141865:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cb283 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607633.141874:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cb283 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607633.141895:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97454c8e3900) 00010000:00010000:0.0:1782607633.141898:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782607633.141904:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cb283 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607633.141911:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cb283 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607633.175247:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607633.175642:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342323328 00000100:00100000:2.0:1782607633.175657:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342323328 00000100:00100000:2.0:1782607633.175882:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 21 00000100:00100000:2.0:1782607633.175898:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:9672:x1869199342323328:12345-192.168.202.4@tcp:101:touch.500 00010000:00010000:2.0:1782607633.175984:0:7437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607633.176034:0:7437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb28a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffc7f expref: -99 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782607633.181273:0:7437:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 5162us 00010000:00010000:1.0:1782607633.192074:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb291 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.192103:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb291 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.192119:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb291 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.192138:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cb298 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.192145:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cb298 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.192164:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cb298 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.192759:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467a00/0x8109266df35cb29f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.193012:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467a00/0x8109266df35cb29f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.193022:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467a00/0x8109266df35cb29f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782607633.193122:0:7437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1782607633.193127:0:7437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782607633.193241:0:7437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467a00/0x8109266df35cb29f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.193258:0:7437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb291 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.193265:0:7437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb291 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.193273:0:7437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb291 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.193279:0:7437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f466400 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607633.193284:0:7437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb291 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.193293:0:7437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb291 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.193317:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97454c8e3000) 00010000:00010000:1.0:1782607633.193320:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607633.193327:0:7437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb291 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.193334:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb291 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.193348:0:7437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cb298 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.193354:0:7437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cb298 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.193360:0:7437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cb298 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.193366:0:7437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f466c00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607633.193369:0:7437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cb298 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.193375:0:7437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cb298 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.193383:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff974543e77c00) 00010000:00010000:1.0:1782607633.193385:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607633.193389:0:7437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cb298 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.193395:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cb298 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.193457:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb28a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc7f expref: 8 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.193488:0:7437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467a00/0x8109266df35cb29f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc7f expref: 7 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.193498:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff974543e77d00) 00010000:00010000:1.0:1782607633.193500:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782607633.193503:0:7437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97457f467a00, rc 0) 00000100:00100000:1.0:1782607633.193598:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:9672:x1869199342323328:12345-192.168.202.4@tcp:101:touch.500 Request processed in 17704us (18364us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607633.193609:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 21 00000100:00100000:2.0:1782607633.199583:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607633.199683:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342323584 00000100:00100000:1.0:1782607633.199697:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342323584 00000100:00100000:1.0:1782607633.199810:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 22 00000100:00100000:1.0:1782607633.199823:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:9672:x1869199342323584:12345-192.168.202.4@tcp:101:touch.500 00010000:00010000:1.0:1782607633.199860:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607633.199890:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cb2a6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffc86 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.200361:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467000/0x8109266df35cb2ad lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.200397:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467000/0x8109266df35cb2ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.200413:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467000/0x8109266df35cb2ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.200589:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb2b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.200610:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb2b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.200620:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb2b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782607633.201643:0:5805:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1782607633.203733:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cb2bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.203755:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cb2bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.203782:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cb2bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.203823:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467000/0x8109266df35cb2ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.203830:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467000/0x8109266df35cb2ad lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.203837:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467000/0x8109266df35cb2ad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.203843:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f467000 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607633.203848:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467000/0x8109266df35cb2ad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.203873:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467000/0x8109266df35cb2ad lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.203886:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff974543e77d00) 00010000:00010000:1.0:1782607633.203889:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607633.203893:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467000/0x8109266df35cb2ad lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.203899:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467000/0x8109266df35cb2ad lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782607633.203910:0:5805:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007c80d35b reply state 000000001ec97b7f transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb2b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607633.203919:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782607633.203958:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cb2a6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc86 expref: 10 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.203972:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cb2bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc86 expref: 9 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.203979:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974543e77f00) 00010000:00010000:1.0:1782607633.203981:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782607633.203984:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97457f467e00, rc 0) 00000100:00100000:1.0:1782607633.204374:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+10:9672:x1869199342323584:12345-192.168.202.4@tcp:101:touch.500 Request processed in 4552us (4807us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1782607633.204626:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 22 00010000:00010000:1.0:1782607633.214395:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb2b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.214433:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb2b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.214442:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb2b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607633.214457:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:1.0:1782607633.214480:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f467600 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607633.214489:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb2b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.214513:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb2b4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607633.214574:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342323840 00000100:00100000:2.0:1782607633.214587:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342323840 00000100:00100000:2.0:1782607633.214655:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 23 00000100:00100000:2.0:1782607633.214666:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745509ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+10:9672:x1869199342323840:12345-192.168.202.4@tcp:36:touch.500 00010000:00010000:2.0:1782607633.214751:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782607633.214830:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cb2bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc86 expref: 10 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.214861:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974543e77f00) 00010000:00010000:2.0:1782607633.214879:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782607633.214890:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xb0620c33 (ffff974543e77a00) 00010000:00010000:1.0:1782607633.214897:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607633.214904:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb2b4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.214913:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb2b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.214941:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb2c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.214962:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb2c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.214974:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb2c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782607633.215174:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fa420da8 reply state 00000000acd8228c transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb2c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607633.215186:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782607633.215340:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745509ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+10:9672:x1869199342323840:12345-192.168.202.4@tcp:36:touch.500 Request processed in 674us (898us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1782607633.215348:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 23 00010000:00010000:1.0:1782607633.217574:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb2c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.217593:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb2c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.217601:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb2c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.217607:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ace00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607633.217629:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb2c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.217637:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb2c9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.217667:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9745432c6400) 00010000:00010000:1.0:1782607633.217671:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607633.217676:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb2c9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.217682:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb2c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607633.217923:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607633.221037:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342323968 00000100:00100000:0.0:1782607633.221059:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342323968 00000100:00100000:1.0:1782607633.221880:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 24 00000100:00100000:1.0:1782607633.221898:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+9:9672:x1869199342323968:12345-192.168.202.4@tcp:101:touch.500 00010000:00010000:1.0:1782607633.221924:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607633.221948:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cb2d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffc8d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.222012:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cb2d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc8d expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.222028:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cb2d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc8d expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607633.222048:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974543e77c00) 00010000:00010000:1.0:1782607633.222051:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782607633.222055:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97457f467c00, rc 0) 00000100:00100000:1.0:1782607633.222131:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+10:9672:x1869199342323968:12345-192.168.202.4@tcp:101:touch.500 Request processed in 238us (4217us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607633.222153:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 24 00000100:00100000:1.0:1782607633.227841:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607633.228146:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342324096 00000100:00100000:2.0:1782607633.228163:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342324096 00000100:00100000:2.0:1782607633.228234:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16 00000100:00100000:2.0:1782607633.228245:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458100b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1869199342324096:12345-192.168.202.4@tcp:8:touch.500 00010000:00080000:2.0:1782607633.228291:0:6608:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from d72d7fb9-639f-4ad9-b658-df715cbf7792@192.168.202.4@tcp t0 exp 0000000000000000 cur 292 last 0 00000020:00000080:2.0:1782607633.228335:0:6608:0:(genops.c:1406:class_connect()) connect: client d72d7fb9-639f-4ad9-b658-df715cbf7792, cookie 0x8109266df35cb2d7 00002000:00100000:2.0:1782607633.228635:0:6608:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d72d7fb9-639f-4ad9-b658-df715cbf7792/ffff974548915000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782607633.228651:0:6608:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1782607633.229279:0:6608:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1782607633.229326:0:6608:0:(import.c:65:import_set_state_nolock()) ffff974548911000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782607633.229524:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458100b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2353:x1869199342324096:12345-192.168.202.4@tcp:8:touch.500 Request processed in 1277us (1695us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607633.229534:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16 00000100:00100000:1.0:1782607633.234556:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607633.234638:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342324224 00000100:00100000:2.0:1782607633.234655:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342324224 00000100:00100000:2.0:1782607633.234760:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17 00000100:00100000:2.0:1782607633.234809:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:0:x1869199342324224:12345-192.168.202.4@tcp:2:touch.500 00000100:00080000:3.0:1782607633.235191:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782607633.299345:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:0:x1869199342324224:12345-192.168.202.4@tcp:2:touch.500 Request processed in 64528us (64785us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1782607633.299369:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17 00000001:00080000:1.0:1782607633.299663:0:6634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:1.0:1782607633.299677:0:6634:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d72d7fb9-639f-4ad9-b658-df715cbf7792 00000100:00100000:0.0:1782607633.303120:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607633.304290:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342324480 00000100:00100000:3.0:1782607633.304304:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342324480 00000100:00100000:3.0:1782607633.304481:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2 00000100:00100000:3.0:1782607633.304494:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745509ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+10:9672:x1869199342324480:12345-192.168.202.4@tcp:35:touch.500 00000100:00100000:3.0:1782607633.304917:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745509ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+11:9672:x1869199342324480:12345-192.168.202.4@tcp:35:touch.500 Request processed in 424us (1808us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1782607633.304925:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2 00000100:00100000:2.0:1782607633.326259:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607633.326550:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342324608 00000100:00100000:0.0:1782607633.326628:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342324608 00000100:00100000:0.0:1782607633.327103:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 25 00000100:00100000:0.0:1782607633.327116:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+11:9673:x1869199342324608:12345-192.168.202.4@tcp:101:rm.0 00010000:00010000:0.0:1782607633.327146:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607633.327167:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42800/0x8109266df35cb2de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffc94 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607633.327253:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42e00/0x8109266df35cb2e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607633.327267:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42e00/0x8109266df35cb2e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607633.327278:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42e00/0x8109266df35cb2e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782607633.327339:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782607633.327344:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1782607633.327394:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42e00/0x8109266df35cb2e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607633.327422:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42800/0x8109266df35cb2de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc94 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607633.327439:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42e00/0x8109266df35cb2e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc94 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607633.327449:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff974543e77d00) 00010000:00010000:0.0:1782607633.327483:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782607633.327487:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c42e00, rc 0) 00000100:00100000:0.0:1782607633.327552:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+12:9673:x1869199342324608:12345-192.168.202.4@tcp:101:rm.0 Request processed in 439us (1303us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607633.327560:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 25 00000100:00100000:1.0:1782607633.344864:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607633.345131:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342324864 00000100:00100000:2.0:1782607633.345142:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342324864 00000100:00100000:2.0:1782607633.345213:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 26 00000100:00100000:2.0:1782607633.345223:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458100aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+12:9673:x1869199342324864:12345-192.168.202.4@tcp:101:rm.0 00010000:00010000:2.0:1782607633.345244:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607633.345282:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb2ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffc9b expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782607633.345577:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1782607633.345749:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb2ec lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc9b expref: 14 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.348595:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97454c8e3000) 00010000:00010000:2.0:1782607633.348605:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782607633.348617:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb2ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc9b expref: 14 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.348637:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585ada00, rc 0) 00000100:00100000:2.0:1782607633.348730:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458100aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+13:9673:x1869199342324864:12345-192.168.202.4@tcp:101:rm.0 Request processed in 3507us (3882us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1782607633.348739:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 26 00000100:00100000:0.0:1782607633.353573:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607633.353716:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342324992 00000100:00100000:2.0:1782607633.353726:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342324992 00000100:00100000:2.0:1782607633.353814:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 3 00000100:00100000:2.0:1782607633.353825:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745509ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+13:9673:x1869199342324992:12345-192.168.202.4@tcp:37:rm.0 00000100:00100000:2.0:1782607633.375643:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745509ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+13:9673:x1869199342324992:12345-192.168.202.4@tcp:37:rm.0 Request processed in 21806us (22072us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607633.375658:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 3 00000100:00100000:1.0:1782607633.389849:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607633.389965:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342325248 00000100:00100000:3.0:1782607633.389987:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342325248 00000100:00100000:3.0:1782607633.390061:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4 00000100:00100000:3.0:1782607633.390075:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549b8a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+13:9673:x1869199342325248:12345-192.168.202.4@tcp:35:rm.0 00000100:00100000:3.0:1782607633.390877:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549b8a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+14:9673:x1869199342325248:12345-192.168.202.4@tcp:35:rm.0 Request processed in 801us (1040us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1782607633.390888:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4 00000100:00100000:0.0:1782607633.400858:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607633.400989:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342325504 00000100:00100000:2.0:1782607633.401002:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342325504 00000100:00100000:2.0:1782607633.401063:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 27 00000100:00100000:2.0:1782607633.401074:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745509ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+14:9673:x1869199342325504:12345-192.168.202.4@tcp:101:rm.0 00010000:00010000:2.0:1782607633.401122:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607633.401145:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb2fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffca2 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.401282:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb301 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.401299:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb301 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.401312:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb301 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782607633.401324:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1782607633.401509:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb2fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffca2 expref: 17 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.401532:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb301 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffca2 expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.401541:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff974543e77d00) 00010000:00010000:2.0:1782607633.401544:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782607633.401548:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585ad000, rc 0) 00000100:00100000:2.0:1782607633.401619:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745509ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+16:9673:x1869199342325504:12345-192.168.202.4@tcp:101:rm.0 Request processed in 546us (770us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1782607633.401626:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 27 00000100:00100000:1.0:1782607633.416631:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607633.416826:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342325632 00000100:00100000:2.0:1782607633.416840:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342325632 00000100:00100000:2.0:1782607633.416916:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 28 00000100:00100000:2.0:1782607633.416957:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+16:9673:x1869199342325632:12345-192.168.202.4@tcp:41:rm.0 00000004:00000024:2.0:1782607633.417051:0:5804:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1782607633.417144:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+16:9673:x1869199342325632:12345-192.168.202.4@tcp:41:rm.0 Request processed in 202us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607633.417152:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 28 00000100:00100000:1.0:1782607633.425741:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607633.425880:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342325760 00000100:00100000:3.0:1782607633.425894:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342325760 00000100:00100000:3.0:1782607633.426179:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 29 00000100:00100000:3.0:1782607633.426193:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458100ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+16:9673:x1869199342325760:12345-192.168.202.4@tcp:101:rm.0 00010000:00010000:3.0:1782607633.426224:0:7437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607633.426258:0:7437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648400/0x8109266df35cb30f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffca9 expref: -99 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607633.426359:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648600/0x8109266df35cb316 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607633.426380:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648600/0x8109266df35cb316 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607633.426396:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648600/0x8109266df35cb316 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607633.426414:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648a00/0x8109266df35cb31d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607633.426422:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648a00/0x8109266df35cb31d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607633.426431:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648a00/0x8109266df35cb31d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607633.426615:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cb324 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607633.426642:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cb324 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607633.426650:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cb324 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782607633.426686:0:7437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1782607633.426692:0:7437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782607633.426715:0:7437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cb324 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607633.426729:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cb324 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607633.426740:0:7437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648600/0x8109266df35cb316 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607633.426747:0:7437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648600/0x8109266df35cb316 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607633.426755:0:7437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648600/0x8109266df35cb316 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607633.426950:0:7437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d648600 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:3.0:1782607633.426957:0:7437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648600/0x8109266df35cb316 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607633.426967:0:7437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648600/0x8109266df35cb316 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607633.427053:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff974543e77d00) 00010000:00010000:3.0:1782607633.427057:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782607633.427070:0:7437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648600/0x8109266df35cb316 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607633.427077:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648600/0x8109266df35cb316 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607633.427095:0:7437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648a00/0x8109266df35cb31d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607633.427102:0:7437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648a00/0x8109266df35cb31d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607633.427108:0:7437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648a00/0x8109266df35cb31d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607633.427114:0:7437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d648a00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:3.0:1782607633.427117:0:7437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648a00/0x8109266df35cb31d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607633.427123:0:7437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648a00/0x8109266df35cb31d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607633.427131:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xb0620c33 (ffff9745454f5500) 00010000:00010000:3.0:1782607633.427133:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782607633.427136:0:7437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648a00/0x8109266df35cb31d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607633.427142:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648a00/0x8109266df35cb31d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607633.427182:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648400/0x8109266df35cb30f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffca9 expref: 18 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607633.427211:0:7437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cb324 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffca9 expref: 17 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607633.427219:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974543e77c00) 00010000:00010000:3.0:1782607633.427221:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782607633.427224:0:7437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97455d649a00, rc 0) 00000100:00100000:3.0:1782607633.427318:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458100ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+17:9673:x1869199342325760:12345-192.168.202.4@tcp:101:rm.0 Request processed in 1127us (1593us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607633.427327:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 29 00000100:00100000:0.0:1782607633.432082:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607633.432268:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342326016 00000100:00100000:2.0:1782607633.432282:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342326016 00000100:00100000:2.0:1782607633.432370:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 30 00000100:00100000:2.0:1782607633.432382:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745509ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+17:9673:x1869199342326016:12345-192.168.202.4@tcp:36:rm.0 00010000:00010000:2.0:1782607633.432476:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1782607633.432834:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cb324 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffca9 expref: 17 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.432868:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cb2d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc8d expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.432881:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff974543e77c00) 00010000:00010000:2.0:1782607633.432913:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42e00/0x8109266df35cb2e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc94 expref: 15 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.432923:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff974543e77d00) 00010000:00010000:2.0:1782607633.432927:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782607633.432956:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb32b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.433185:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb32b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.433222:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb32b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.433242:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad400/0x8109266df35cb332 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.433250:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad400/0x8109266df35cb332 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.433257:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad400/0x8109266df35cb332 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.433426:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb339 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.433435:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb339 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.433443:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb339 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782607633.437640:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1782607633.437661:0:5804:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 292283895082ns, next at 293283890980ns, rc = 0 00010000:00010000:2.0:1782607633.438714:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb340 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.438741:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb340 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.438758:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb340 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.439255:0:5804:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb340 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.439266:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb340 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.439274:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb340 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.439509:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782607633.439558:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb339 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.439565:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb339 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.439573:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb339 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.439579:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ac600 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607633.439585:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb339 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.439594:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb339 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.439613:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9745432c6f00) 00010000:00010000:2.0:1782607633.439616:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782607633.439621:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb339 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.439641:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb339 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.439674:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb32b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.439680:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb32b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.439686:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb32b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.439690:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ada00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607633.439693:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb32b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.439699:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb32b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.439707:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff974543e77d00) 00010000:00010000:2.0:1782607633.439710:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607633.439713:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb32b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.439719:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb32b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782607633.439731:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000036c7351c reply state 00000000c5d3057e transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad400/0x8109266df35cb332 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607633.439741:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782607633.439997:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745509ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+16:9673:x1869199342326016:12345-192.168.202.4@tcp:36:rm.0 Request processed in 7609us (7927us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1782607633.440009:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 30 00010000:00010000:2.0:1782607633.443607:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad400/0x8109266df35cb332 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.443633:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad400/0x8109266df35cb332 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.443642:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad400/0x8109266df35cb332 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.443650:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ad400 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607633.443655:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad400/0x8109266df35cb332 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.443663:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad400/0x8109266df35cb332 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.443687:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xb0620c33 (ffff9745432c6b00) 00010000:00010000:2.0:1782607633.443690:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607633.443696:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad400/0x8109266df35cb332 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.443702:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad400/0x8109266df35cb332 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb0620c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607633.445412:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782607633.445429:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb340 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607633.445440:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585acc00 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:0.0:1782607633.445445:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb340 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607633.445454:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb340 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607633.445486:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9745432c6f00) 00010000:00010000:0.0:1782607633.445490:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782607633.445494:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb340 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607633.445501:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb340 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607633.445544:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607633.445546:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607633.445547:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782607633.449682:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607633.450171:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342326272 00000100:00100000:3.0:1782607633.450186:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342326272 00000100:00100000:3.0:1782607633.450259:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5 00000100:00100000:3.0:1782607633.450271:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745509edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+15:9673:x1869199342326272:12345-192.168.202.4@tcp:35:rm.0 00000100:00100000:3.0:1782607633.450695:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745509edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+16:9673:x1869199342326272:12345-192.168.202.4@tcp:35:rm.0 Request processed in 424us (1026us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1782607633.450704:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5 00000100:00100000:1.0:1782607633.456003:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607633.456254:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342326528 00000100:00100000:2.0:1782607633.456268:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342326528 00000100:00100000:2.0:1782607633.456368:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 31 00000100:00100000:2.0:1782607633.456382:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458100b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+16:9673:x1869199342326528:12345-192.168.202.4@tcp:36:rm.0 00010000:00010000:2.0:1782607633.456500:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1782607633.456548:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb301 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffca2 expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.456578:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467a00/0x8109266df35cb29f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc7f expref: 15 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.456591:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff974543e77d00) 00010000:00010000:2.0:1782607633.456610:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cb260 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc71 expref: 14 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.456620:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97454c8e3000) 00010000:00010000:2.0:1782607633.456634:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782607633.456666:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad400/0x8109266df35cb347 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.456682:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad400/0x8109266df35cb347 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.456691:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad400/0x8109266df35cb347 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.456706:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb34e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.456713:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb34e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.456718:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb34e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.458558:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb355 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.458579:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb355 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.458590:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb355 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782607633.460965:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1782607633.461010:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb355 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.461022:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb355 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.461031:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb355 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.461037:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ac600 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607633.461043:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb355 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.461052:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb355 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.461072:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9745432c6c00) 00010000:00010000:2.0:1782607633.461075:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782607633.461080:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb355 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.461333:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb355 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.461756:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad400/0x8109266df35cb347 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.461847:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad400/0x8109266df35cb347 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.461855:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad400/0x8109266df35cb347 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.461860:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ad400 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607633.461864:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad400/0x8109266df35cb347 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.461869:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad400/0x8109266df35cb347 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.461881:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9745432c6b00) 00010000:00010000:2.0:1782607633.461885:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607633.461889:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad400/0x8109266df35cb347 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607633.461895:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad400/0x8109266df35cb347 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782607633.461913:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003775d2dd reply state 0000000079a17ff7 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb34e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607633.461925:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782607633.464730:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458100b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+15:9673:x1869199342326528:12345-192.168.202.4@tcp:36:rm.0 Request processed in 8333us (8735us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1782607633.464749:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 31 00010000:00010000:0.0:1782607633.477870:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb34e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607633.477896:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb34e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607633.477905:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb34e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607633.477912:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ada00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607633.477919:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb34e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607633.477928:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb34e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607633.477953:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9745432c6300) 00010000:00010000:0.0:1782607633.477957:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782607633.477977:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb34e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607633.477986:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb34e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607633.602730:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607634.629425:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607635.650022:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607635.696729:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607635.696805:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607635.696850:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607635.696884:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607635.696920:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342326656 00000100:00100000:1.0:1782607635.696933:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342326656 00000100:00100000:1.0:1782607635.696998:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 248 00000100:00100000:1.0:1782607635.697010:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2357:x1869199342326656:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1782607635.697107:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2357:x1869199342326656:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 98us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607635.697116:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 248 00000100:00100000:1.0:1782607635.697162:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342326912 00000100:00100000:1.0:1782607635.697165:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342326912 00000100:00100000:1.0:1782607635.697245:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 58 00000100:00100000:1.0:1782607635.697252:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581008700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2357:x1869199342326912:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1782607635.697284:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581008700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2357:x1869199342326912:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 34us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607635.697291:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 58 00000100:00100000:0.0:1782607635.697653:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342326784 00000100:00100000:0.0:1782607635.697661:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342326784 00000100:00100000:0.0:1782607635.697719:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342327040 00000100:00100000:0.0:1782607635.697723:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342327040 00000100:00100000:0.0:1782607635.697751:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 101 00000100:00100000:0.0:1782607635.697760:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458100b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+14:2357:x1869199342326784:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1782607635.697835:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458100b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+14:2357:x1869199342326784:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 77us (1123us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607635.697852:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 101 00000100:00100000:0.0:1782607635.697869:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 102 00000100:00100000:0.0:1782607635.697876:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2357:x1869199342327040:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1782607635.697908:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2357:x1869199342327040:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 33us (1102us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607635.697914:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 102 00000100:00080000:3.0:1782607635.698182:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782607635.698189:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782607636.034058:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457ff1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1869199364380160:0@lo:400:kworker.0 00000100:00100000:0.0:1782607636.034314:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1869199364380032:0@lo:400:kworker.0 00000100:00100000:0.0:1782607636.034391:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607636.034467:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580c06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364380544:0@lo:400:kworker.0 00000100:00100000:0.0:1782607636.034496:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607636.034529:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1782607636.034534:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745508ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364379904:0@lo:400:kworker.0 00000100:00100000:0.0:1782607636.034584:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607636.034606:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457ff1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1869199364380416:0@lo:400:kworker.0 00000100:00100000:0.0:1782607636.034628:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607636.034661:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364380032 00000100:00100000:0.0:1782607636.034669:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364380032 00000100:00100000:0.0:1782607636.034717:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364380416 00000100:00100000:0.0:1782607636.034719:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364380416 00000100:00100000:0.0:1782607636.034751:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1782607636.034760:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457718f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1869199364380032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607636.034847:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457718f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1869199364380032:12345-0@lo:400:kworker.0 Request processed in 88us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607636.034855:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1782607636.034884:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1782607636.034890:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457718dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1869199364380416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607636.034919:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457718dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1869199364380416:12345-0@lo:400:kworker.0 Request processed in 28us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607636.034925:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1782607636.034945:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364379904 00000100:00100000:0.0:1782607636.034949:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364379904 00000100:00100000:0.0:1782607636.035087:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1782607636.035092:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3319:x1869199364379904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607636.035122:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3319:x1869199364379904:12345-0@lo:400:kworker.0 Request processed in 30us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607636.035127:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1782607636.035245:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745508ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364379904:0@lo:400:kworker.0 00000100:00100000:0.0:1782607636.035260:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457ff1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1869199364380416:0@lo:400:kworker.0 00000100:00100000:0.0:1782607636.035268:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1869199364380032:0@lo:400:kworker.0 00000100:00100000:3.0:1782607636.035379:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607636.035412:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782607636.035419:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457ff1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364380288:0@lo:400:kworker.0 00000100:00100000:3.0:1782607636.035455:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607636.035502:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364380160 00000100:00100000:3.0:1782607636.035506:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364380160 00000100:00100000:3.0:1782607636.035529:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1782607636.035535:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580c05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869199364380160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607636.035586:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580c05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869199364380160:12345-0@lo:400:kworker.0 Request processed in 51us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607636.035591:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:3.0:1782607636.035608:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782607636.035622:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364380544 00000100:00100000:3.0:1782607636.035625:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364380544 00000100:00100000:3.0:1782607636.035651:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364380288 00000100:00100000:3.0:1782607636.035653:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364380288 00000100:00100000:3.0:1782607636.035673:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1782607636.035678:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457718e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364380544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607636.035713:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457718e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364380544:12345-0@lo:400:kworker.0 Request processed in 35us (1216us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607636.035719:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1782607636.035729:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1782607636.035733:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580c04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364380288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607636.035758:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580c04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364380288:12345-0@lo:400:kworker.0 Request processed in 25us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607636.035785:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:3.0:1782607636.035811:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97457ff1ed80 x1869199364380288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607636.035823:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457ff1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364380288:0@lo:400:kworker.0 00000100:00100000:3.0:1782607636.035834:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457ff1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1869199364380160:0@lo:400:kworker.0 00000100:00080000:3.0:1782607636.035861:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782607636.035864:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1782607636.035887:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974580c06a00 x1869199364380544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607636.035896:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580c06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364380544:0@lo:400:kworker.0 00000100:00100000:3.0:1782607636.546070:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580c06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364380672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782607636.546178:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607636.546425:0:6613:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364380672 00000100:00100000:1.0:1782607636.546449:0:6613:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364380672 00000100:00100000:1.0:1782607636.546535:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1782607636.546548:0:6613:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580c07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364380672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782607636.546605:0:6613:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782607636.546661:0:6613:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580c07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364380672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607636.546669:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1782607636.546679:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974580c06a00 x1869199364380672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607652 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607636.546701:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580c06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364380672:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782607636.677695:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1782607637.571025:0:6711:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 296417254880ns, next at 297417251185ns, rc = 0 00000100:00100000:0.0:1782607637.571069:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782607637.571101:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457718df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364380800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782607637.571215:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607637.571608:0:6613:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364380800 00000100:00100000:1.0:1782607637.571621:0:6613:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364380800 00000100:00100000:1.0:1782607637.571707:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1782607637.571720:0:6613:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457718fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364380800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782607637.571795:0:6613:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782607637.571859:0:6613:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457718fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364380800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607637.571866:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1782607637.571927:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97457718df80 x1869199364380800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607653 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607637.571952:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457718df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364380800:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782607637.714486:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782607638.202524:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:2.0:1782607638.202560:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967300 is committed 00000001:00080000:2.0:1782607638.202572:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1782607638.202579:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1782607638.202883:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782607638.203035:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364380928:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782607638.203157:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607638.203245:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364380928 00000100:00100000:1.0:1782607638.203256:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364380928 00000100:00100000:1.0:1782607638.203421:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782607638.203448:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364380928:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782607638.203491:0:6610:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1782607638.203546:0:6610:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a406f12, atime: 0x6a406f12, ctime: 0x6a406f12, blocks: 0x1 00010000:00010000:1.0:1782607638.203558:0:6610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009962595e/0x8109266df35cb35c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607638.203584:0:6610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=297s v=(0 0) 00010000:00010000:1.0:1782607638.203590:0:6610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607638.203598:0:6610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009962595e/0x8109266df35cb35c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607638.203619:0:6610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009962595e/0x8109266df35cb35c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607638.203631:0:6610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009962595e/0x8109266df35cb35c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607638.203639:0:6610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009962595e/0x8109266df35cb35c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607638.203663:0:6610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:2.0:1782607638.205160:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782607638.206149:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782607638.206166:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009962595e/0x8109266df35cb35c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607638.206185:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f466200 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:3.0:1782607638.206192:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009962595e/0x8109266df35cb35c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607638.206205:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009962595e/0x8109266df35cb35c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607638.206242:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009962595e/0x8109266df35cb35c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607638.206265:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009962595e/0x8109266df35cb35c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607638.206299:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607638.206303:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607638.206305:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607638.207202:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3319:x1869199364380928:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3752us (4039us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1782607638.207228:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:3.0:1782607638.207266:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff974581008380/2, rc 0, transno 4294967300 00000100:00100000:3.0:1782607638.207277:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364380928:0@lo:6:osp-syn-0-0.0 00000001:02000400:3.0:1782607638.284481:0:11495:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:1.0:1782607638.681042:0:6634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:0.0:1782607638.725822:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607639.754265:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782607639.852500:0:11545:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffde30c8020 20000000:00000080:3.0:1782607639.852521:0:11545:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97457f5a1c00 uarg=0000000000000000 20000000:01000000:3.0:1782607639.852561:0:11545:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1782607639.852568:0:11545:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1782607639.852574:0:11545:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1782607639.853987:0:11546:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1782607639.854276:0:11545:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1782607639.886513:0:11545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1782607639.886571:0:11545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1782607639.886631:0:11545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1782607639.886650:0:11545:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1782607639.886672:0:11545:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97457f466a00/0x8109266df35cb363 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607639.886706:0:11545:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97455d648200/0x8109266df35cb205 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cb1fe expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607639.886714:0:11545:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff974546c43800/0x8109266df35cb213 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cb20c expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607639.886721:0:11545:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97455d649200/0x8109266df35cb221 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cb21a expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607639.886731:0:11545:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff974546c43400/0x8109266df35cb228 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc5c expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607639.886739:0:11545:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97455d648e00/0x8109266df35cb22f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc63 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607639.886748:0:11545:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97457f466a00/0x8109266df35cb363 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607639.886833:0:11545:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97455d648e00/0x8109266df35cb22f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc63 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607639.886850:0:11545:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97455d648e00/0x8109266df35cb22f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc63 expref: 12 pid: 5798 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607639.886872:0:11545:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974547739880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11545:1869199364381056:192.168.202.4@tcp:104: 00010000:00010000:1.0:1782607639.887157:0:11545:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff974546c43400/0x8109266df35cb228 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc5c expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607639.887166:0:11545:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff974546c43400/0x8109266df35cb228 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc5c expref: 12 pid: 5798 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607639.887175:0:11545:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97454773aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11545:1869199364381184:192.168.202.4@tcp:104: 00010000:00010000:1.0:1782607639.887204:0:11545:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97455d649200/0x8109266df35cb221 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8109266df35cb21a expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607639.887213:0:11545:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97455d649200/0x8109266df35cb221 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8109266df35cb21a expref: 18 pid: 5797 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607639.887222:0:11545:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97454773b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11545:1869199364381312:0@lo:104: 00000100:00100000:1.0:1782607639.887262:0:11545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782607639.887429:0:11545:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff974546c43800/0x8109266df35cb213 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8109266df35cb20c expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607639.887437:0:11545:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff974546c43800/0x8109266df35cb213 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8109266df35cb20c expref: 18 pid: 5795 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607639.887446:0:11545:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974547739c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11545:1869199364381440:0@lo:104: 00000100:00100000:1.0:1782607639.887467:0:11545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782607639.887487:0:11545:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97455d648200/0x8109266df35cb205 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8109266df35cb1fe expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607639.887494:0:11545:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97455d648200/0x8109266df35cb205 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8109266df35cb1fe expref: 18 pid: 5798 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607639.887510:0:11545:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97454773bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11545:1869199364381568:0@lo:104: 00000100:00100000:1.0:1782607639.887548:0:11545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607639.887559:0:11545:0:(client.c:2701:ptlrpc_set_wait()) set ffff974577a593c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782607639.888556:0:5786:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1782607639.888572:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364381312 00000100:00100000:0.0:1782607639.888580:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364381312 00000100:00100000:0.0:1782607639.888621:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364381440 00000100:00100000:0.0:1782607639.888625:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364381440 00000100:00100000:0.0:1782607639.888647:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364381568 00000100:00100000:0.0:1782607639.888650:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364381568 00000100:00100000:0.0:1782607639.888664:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782607639.888674:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97454773a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+5:11545:x1869199364381312:12345-0@lo:104: 00010000:00010000:0.0:1782607639.888700:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff974546c43600/0x8109266df35cb21a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cb221 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607639.888808:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782607639.888814:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97454773a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+5:11545:x1869199364381312:12345-0@lo:104: Request processed in 142us (1552us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607639.888822:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782607639.888839:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782607639.888845:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974547739f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+4:11545:x1869199364381440:12345-0@lo:104: 00010000:00010000:0.0:1782607639.888852:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff974546c43c00/0x8109266df35cb20c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cb213 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607639.888899:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1782607639.888905:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974547739f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+4:11545:x1869199364381440:12345-0@lo:104: Request processed in 60us (1437us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607639.888910:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782607639.888923:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782607639.888928:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457776fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+3:11545:x1869199364381568:12345-0@lo:104: 00010000:00010000:0.0:1782607639.888936:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff974546c43000/0x8109266df35cb1fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cb205 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607639.888976:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1782607639.888982:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457776fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+3:11545:x1869199364381568:12345-0@lo:104: Request processed in 54us (1433us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607639.888997:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1782607639.889037:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782607639.889043:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974546c43600/0x8109266df35cb21a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cb221 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607639.889051:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c43600 already unused, calling callback (ffffffffc1db0c20) 10000000:00010000:0.0:1782607639.889054:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974546c43600/0x8109266df35cb21a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8109266df35cb221 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607639.889062:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974546c43600/0x8109266df35cb21a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8109266df35cb221 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782607639.889069:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974546c43600/0x8109266df35cb21a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8109266df35cb221 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782607639.889074:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782607639.889109:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974546c43600/0x8109266df35cb21a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cb221 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607639.889115:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782607639.889135:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974546c43600/0x8109266df35cb21a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cb221 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607639.889141:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974546c43600/0x8109266df35cb21a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cb221 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607639.889154:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782607639.889157:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974546c43c00/0x8109266df35cb20c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cb213 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607639.889173:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c43c00 already unused, calling callback (ffffffffc1db0c20) 10000000:00010000:0.0:1782607639.889176:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974546c43c00/0x8109266df35cb20c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8109266df35cb213 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607639.889182:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974546c43c00/0x8109266df35cb20c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8109266df35cb213 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782607639.889189:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974546c43c00/0x8109266df35cb20c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8109266df35cb213 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782607639.889194:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782607639.889207:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974546c43c00/0x8109266df35cb20c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cb213 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607639.889213:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782607639.889229:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974546c43c00/0x8109266df35cb20c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cb213 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607639.889235:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974546c43c00/0x8109266df35cb20c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cb213 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607639.889244:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782607639.889247:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974546c43000/0x8109266df35cb1fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cb205 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607639.889252:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c43000 already unused, calling callback (ffffffffc1db0c20) 10000000:00010000:0.0:1782607639.889255:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974546c43000/0x8109266df35cb1fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8109266df35cb205 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607639.889270:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974546c43000/0x8109266df35cb1fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8109266df35cb205 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782607639.889277:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974546c43000/0x8109266df35cb1fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8109266df35cb205 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782607639.889282:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782607639.889301:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974546c43000/0x8109266df35cb1fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cb205 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607639.889308:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782607639.889314:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974546c43000/0x8109266df35cb1fe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cb205 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607639.889320:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974546c43000/0x8109266df35cb1fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cb205 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607639.889336:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607639.889338:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607639.889340:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607639.889346:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782607639.889367:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457718d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364381696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782607639.889399:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607639.889456:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457718ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fae11c6e-4506-4104-bb8c-df42498f7e08:3316:1869199364381824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782607639.889479:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607639.889497:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782607639.889502:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457718f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fae11c6e-4506-4104-bb8c-df42498f7e08:3316:1869199364381952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782607639.889524:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607639.889560:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364381696 00000100:00100000:0.0:1782607639.889565:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364381696 00010000:00010000:0.0:1782607639.889584:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97455d649200/0x8109266df35cb221 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cb21a expref: 19 pid: 5797 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607639.889598:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364381824 00000100:00100000:0.0:1782607639.889600:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364381824 00010000:00010000:0.0:1782607639.889609:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff974546c43800/0x8109266df35cb213 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cb20c expref: 20 pid: 5795 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607639.889617:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364381952 00000100:00100000:0.0:1782607639.889619:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364381952 00010000:00010000:0.0:1782607639.889629:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97455d648200/0x8109266df35cb205 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cb1fe expref: 21 pid: 5798 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607639.889641:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782607639.889647:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457718f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+21:3319:x1869199364381696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782607639.889657:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782607639.889662:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97455d649200/0x8109266df35cb221 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cb21a expref: 21 pid: 5797 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607639.889671:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97455d649200/0x8109266df35cb221 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8109266df35cb21a expref: 21 pid: 5797 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607639.889688:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782607639.889714:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457718f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+21:3319:x1869199364381696:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607639.889720:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782607639.889733:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782607639.889739:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457718ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+20:3316:x1869199364381824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782607639.889755:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782607639.889759:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff974546c43800/0x8109266df35cb213 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cb20c expref: 20 pid: 5795 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607639.889790:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff974546c43800/0x8109266df35cb213 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8109266df35cb20c expref: 20 pid: 5795 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607639.889799:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782607639.889824:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457718ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+20:3316:x1869199364381824:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607639.889831:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782607639.889844:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1782607639.889849:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974548806850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3316:x1869199364381952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782607639.889856:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782607639.889860:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97455d648200/0x8109266df35cb205 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cb1fe expref: 19 pid: 5798 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607639.889867:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97455d648200/0x8109266df35cb205 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8109266df35cb1fe expref: 19 pid: 5798 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607639.889876:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782607639.889896:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974548806850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3316:x1869199364381952:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607639.889902:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1782607639.889966:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457718d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364381696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782607639.889991:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457718f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fae11c6e-4506-4104-bb8c-df42498f7e08:3316:1869199364381952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782607639.889997:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457718ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fae11c6e-4506-4104-bb8c-df42498f7e08:3316:1869199364381824:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782607639.890043:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607639.891192:0:11545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97455d649200/0x8109266df35cb221 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8109266df35cb21a expref: 18 pid: 5797 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607639.891208:0:11545:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97454773b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11545:1869199364381312:0@lo:104: 00010000:00010000:1.0:1782607639.891218:0:11545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974546c43800/0x8109266df35cb213 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8109266df35cb20c expref: 17 pid: 5795 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607639.891226:0:11545:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974547739c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11545:1869199364381440:0@lo:104: 00010000:00010000:1.0:1782607639.891236:0:11545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97455d648200/0x8109266df35cb205 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8109266df35cb1fe expref: 16 pid: 5798 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607639.891244:0:11545:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97454773bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11545:1869199364381568:0@lo:104: 00000100:00100000:1.0:1782607639.905547:0:11545:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974547739880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11545:1869199364381056:192.168.202.4@tcp:104: 00000100:00100000:1.0:1782607639.905562:0:11545:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97454773aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11545:1869199364381184:192.168.202.4@tcp:104: 00010000:00010000:1.0:1782607639.905594:0:11545:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97457f466a00/0x8109266df35cb363 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607639.910659:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607639.910717:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607639.911028:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342327168 00000100:00100000:2.0:1782607639.911040:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342327168 00010000:00010000:2.0:1782607639.911084:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97455d648e00/0x8109266df35cb22f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc63 expref: 13 pid: 5798 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607639.911131:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342327296 00000100:00100000:2.0:1782607639.911134:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342327296 00010000:00010000:2.0:1782607639.911146:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff974546c43400/0x8109266df35cb228 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc5c expref: 14 pid: 5798 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607639.911159:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 33 00000100:00100000:2.0:1782607639.911166:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97454773aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+14:2356:x1869199342327168:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782607639.911180:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782607639.911185:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97455d648e00/0x8109266df35cb22f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc63 expref: 14 pid: 5798 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607639.911195:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97455d648e00/0x8109266df35cb22f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc63 expref: 14 pid: 5798 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607639.911212:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97455d648e00/0x8109266df35cb22f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc63 expref: 14 pid: 5798 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607639.911227:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782607639.911283:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97454773aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2356:x1869199342327168:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 117us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607639.911310:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 33 00000100:00100000:2.0:1782607639.911498:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 34 00000100:00100000:2.0:1782607639.911505:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974547739880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+12:2356:x1869199342327296:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782607639.911513:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782607639.911517:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff974546c43400/0x8109266df35cb228 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc5c expref: 12 pid: 5798 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607639.911525:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff974546c43400/0x8109266df35cb228 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc5c expref: 12 pid: 5798 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607639.911534:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974546c43400/0x8109266df35cb228 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc5c expref: 12 pid: 5798 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607639.911544:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97457f466a00/0x8109266df35cb363 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607639.911552:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97457f466a00/0x8109266df35cb363 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607639.911567:0:5789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97457f466a00/0x8109266df35cb363 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607639.911574:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97457f466a00/0x8109266df35cb363 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607639.911582:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97457f466a00/0x8109266df35cb363 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607639.911588:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97457f466a00/0x8109266df35cb363 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607639.911600:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f466a00 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:2.0:1782607639.911605:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97457f466a00/0x8109266df35cb363 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607639.911612:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97457f466a00/0x8109266df35cb363 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607639.911624:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97457f466a00/0x8109266df35cb363 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607639.911636:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782607639.911654:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974547739880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+11:2356:x1869199342327296:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 150us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607639.911660:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 34 00010000:00010000:1.0:1782607639.912591:0:11545:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97457f466a00/0x8109266df35cb363 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607639.912605:0:11545:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97457f466a00/0x8109266df35cb363 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607639.912631:0:11545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97457f466a00/0x8109266df35cb363 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607640.770206:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782607640.808946:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607640.809013:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607640.809056:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607640.809156:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342327552 00000100:00100000:0.0:1782607640.809167:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342327552 00000100:00100000:0.0:1782607640.809226:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342327808 00000100:00100000:0.0:1782607640.809229:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342327808 00000100:00100000:0.0:1782607640.809252:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 106 00000100:00100000:0.0:1782607640.809262:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580c06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2354:x1869199342327552:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1782607640.809348:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580c06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2354:x1869199342327552:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 87us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607640.809356:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 106 00000100:00100000:0.0:1782607640.809372:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 107 00000100:00100000:0.0:1782607640.809379:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745776b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2354:x1869199342327808:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1782607640.809403:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745776b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2354:x1869199342327808:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 25us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607640.809419:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 107 00000100:00080000:0.0:1782607640.809455:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782607640.809675:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607640.811313:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342327680 00000100:00100000:0.0:1782607640.811324:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342327680 00000100:00100000:0.0:1782607640.811416:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 61 00000100:00100000:0.0:1782607640.811428:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745776b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2354:x1869199342327680:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1782607640.811507:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745776b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2354:x1869199342327680:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 81us (1832us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607640.811516:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 61 00000100:00080000:1.0:1782607640.811727:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782607640.811805:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342327424 00000100:00100000:2.0:1782607640.811811:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342327424 00000100:00100000:2.0:1782607640.811850:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 250 00000100:00100000:2.0:1782607640.811858:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+11:2354:x1869199342327424:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607640.815110:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+11:2354:x1869199342327424:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 3241us (6042us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607640.815124:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 250 00000100:00100000:3.0:1782607641.154069:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97454773b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1869199364382336:0@lo:400:kworker.0 00000100:00100000:3.0:1782607641.154140:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607641.154231:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974547739c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1869199364382208:0@lo:400:kworker.0 00000100:00100000:2.0:1782607641.154270:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607641.154304:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782607641.154309:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97454773bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364382080:0@lo:400:kworker.0 00000100:00100000:2.0:1782607641.154333:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607641.154394:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364382080 00000100:00100000:2.0:1782607641.154411:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364382080 00000100:00100000:2.0:1782607641.154458:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1782607641.154465:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+16:3319:x1869199364382080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607641.154510:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+16:3319:x1869199364382080:12345-0@lo:400:kworker.0 Request processed in 45us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607641.154517:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1782607641.154543:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364382336 00000100:00100000:2.0:1782607641.154546:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364382336 00000100:00100000:2.0:1782607641.154572:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364382208 00000100:00100000:2.0:1782607641.154574:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364382208 00000100:00100000:2.0:1782607641.154588:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1782607641.154593:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745776b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869199364382336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607641.154670:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1782607641.154679:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974567325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1869199364382208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607641.154717:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974567325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1869199364382208:12345-0@lo:400:kworker.0 Request processed in 41us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607641.154724:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:0.0:1782607641.154803:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782607641.154961:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97454773bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364382080:0@lo:400:kworker.0 00000100:00100000:0.0:1782607641.154974:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974547739c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1869199364382208:0@lo:400:kworker.0 00000100:00100000:0.0:1782607641.160091:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974547739500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364382464:0@lo:400:kworker.0 00000100:00100000:0.0:1782607641.160182:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607641.160254:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364382464 00000100:00100000:0.0:1782607641.160274:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364382464 00000100:00100000:0.0:1782607641.160339:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782607641.160350:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457718ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364382464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607641.160418:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457718ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364382464:12345-0@lo:400:kworker.0 Request processed in 70us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607641.160425:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1782607641.160450:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782607641.160478:0:3317:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1782607641.160484:0:3317:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974581008380, transno 4294967300 00000100:00100000:0.0:1782607641.160498:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974547739500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364382464:0@lo:400:kworker.0 00000100:00100000:2.0:1782607641.161169:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745776b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869199364382336:12345-0@lo:400:kworker.0 Request processed in 6572us (7026us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607641.161179:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1782607641.168441:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97454773b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364382720:0@lo:400:kworker.0 00000100:00100000:0.0:1782607641.168516:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607641.168556:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782607641.168562:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97454773ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1869199364382592:0@lo:400:kworker.0 00000100:00100000:0.0:1782607641.168592:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607641.168622:0:9088:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364382720 00000100:00100000:0.0:1782607641.168643:0:9088:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364382720 00000100:00100000:0.0:1782607641.168697:0:9088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1782607641.168707:0:9088:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457718f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364382720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607641.168757:0:9088:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457718f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364382720:12345-0@lo:400:kworker.0 Request processed in 52us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607641.168796:0:9088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1782607641.168817:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782607641.168840:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364382592 00000100:00100000:0.0:1782607641.168843:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364382592 00000100:00100000:0.0:1782607641.168871:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1782607641.168877:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457718d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1869199364382592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607641.168905:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457718d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1869199364382592:12345-0@lo:400:kworker.0 Request processed in 28us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607641.168911:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:0.0:1782607641.168940:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782607641.168966:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97454773ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1869199364382592:0@lo:400:kworker.0 00010000:00080000:0.0:1782607641.168978:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97454773b480 x1869199364382720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782607641.168988:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97454773b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364382720:0@lo:400:kworker.0 00000100:00100000:3.0:1782607641.176656:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97454773b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1869199364382336:0@lo:400:kworker.0 00000100:00100000:1.0:1782607641.263544:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607641.263649:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342327936 00000100:00100000:2.0:1782607641.263660:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342327936 00000100:00100000:2.0:1782607641.263721:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 252 00000100:00100000:2.0:1782607641.263733:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+11:5571:x1869199342327936:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782607641.263757:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607641.263810:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9745585ad400/0x8109266df35cb36a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffcb0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607641.263842:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9745585ad400/0x8109266df35cb36a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffcb0 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607641.263854:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9745585ad400/0x8109266df35cb36a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffcb0 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607641.263879:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585ad400, rc 0) 00000100:00100000:2.0:1782607641.263959:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+12:5571:x1869199342327936:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 227us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607641.263967:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 252 00000100:00100000:3.0:1782607641.266862:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607641.266943:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342328064 00000100:00100000:0.0:1782607641.266955:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342328064 00000100:00100000:0.0:1782607641.267022:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 253 00000100:00100000:0.0:1782607641.267032:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974548ac5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+12:5571:x1869199342328064:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782607641.267329:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974548ac5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+12:5571:x1869199342328064:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 Request processed in 297us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607641.267337:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 253 00000100:00100000:3.0:1782607641.271675:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607641.274179:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342328192 00000100:00100000:1.0:1782607641.274193:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342328192 00000100:00100000:1.0:1782607641.274254:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 254 00000100:00100000:1.0:1782607641.274264:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974548ac5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+12:5571:x1869199342328192:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782607641.274531:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974548ac5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+12:5571:x1869199342328192:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 Request processed in 267us (2867us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607641.274540:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 254 00000100:00100000:1.0:1782607641.281837:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607641.283332:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342328320 00000100:00100000:3.0:1782607641.283373:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342328320 00000100:00100000:3.0:1782607641.283466:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 255 00000100:00100000:3.0:1782607641.283478:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974548ac7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+12:9944:x1869199342328320:12345-192.168.202.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782607641.283869:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974548ac7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+12:9944:x1869199342328320:12345-192.168.202.4@tcp:502:llog_process_th.0 Request processed in 391us (2102us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607641.283890:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 255 00000100:00100000:3.0:1782607641.294069:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607641.294265:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342328448 00000100:00100000:0.0:1782607641.294283:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342328448 00000100:00100000:0.0:1782607641.294367:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 256 00000100:00100000:0.0:1782607641.294380:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+12:9944:x1869199342328448:12345-192.168.202.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782607641.294677:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+12:9944:x1869199342328448:12345-192.168.202.4@tcp:502:llog_process_th.0 Request processed in 299us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607641.294686:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 256 00000100:00100000:1.0:1782607641.305138:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607641.305316:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342328576 00000100:00100000:3.0:1782607641.305327:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342328576 00000100:00100000:3.0:1782607641.305389:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 257 00000100:00100000:3.0:1782607641.305399:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+12:5571:x1869199342328576:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782607641.305426:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607641.305445:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97455d648400/0x8109266df35cb371 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffcb7 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607641.305475:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97455d648400/0x8109266df35cb371 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffcb7 expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607641.305488:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97455d648400/0x8109266df35cb371 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffcb7 expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607641.305498:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97455d648400, rc 0) 00000100:00100000:3.0:1782607641.305567:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:5571:x1869199342328576:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 169us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607641.305575:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 257 00000100:00100000:2.0:1782607641.334332:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607641.334450:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342328704 00000100:00100000:1.0:1782607641.334461:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342328704 00000100:00100000:1.0:1782607641.334539:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 258 00000100:00100000:1.0:1782607641.334552:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:5571:x1869199342328704:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782607641.335009:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:5571:x1869199342328704:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 Request processed in 458us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607641.335024:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 258 00000100:00100000:2.0:1782607641.343281:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607641.343454:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342328832 00000100:00100000:0.0:1782607641.343465:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342328832 00000100:00100000:0.0:1782607641.343530:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 259 00000100:00100000:0.0:1782607641.343543:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:5571:x1869199342328832:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782607641.343835:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:5571:x1869199342328832:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 Request processed in 295us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607641.343843:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 259 00000100:00100000:1.0:1782607641.351072:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607641.353491:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342328960 00000100:00100000:3.0:1782607641.353510:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342328960 00000100:00100000:3.0:1782607641.355359:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 260 00000100:00100000:3.0:1782607641.355390:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:9947:x1869199342328960:12345-192.168.202.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782607641.356006:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:9947:x1869199342328960:12345-192.168.202.4@tcp:502:llog_process_th.0 Request processed in 629us (4946us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607641.356016:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 260 00000100:00100000:1.0:1782607641.360893:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607641.360997:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342329088 00000100:00100000:0.0:1782607641.361009:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342329088 00000100:00100000:0.0:1782607641.361083:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 261 00000100:00100000:0.0:1782607641.361094:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:9947:x1869199342329088:12345-192.168.202.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782607641.362218:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:9947:x1869199342329088:12345-192.168.202.4@tcp:502:llog_process_th.0 Request processed in 1118us (1332us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607641.362230:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 261 00000100:00100000:0.0:1782607641.666249:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745776b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364382848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782607641.666472:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607641.669110:0:6613:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364382848 00000100:00100000:1.0:1782607641.669130:0:6613:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364382848 00000100:00100000:1.0:1782607641.669406:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1782607641.669440:0:6613:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457718f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364382848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782607641.669500:0:6613:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782607641.678362:0:6613:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457718f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364382848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8910us (11875us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607641.678381:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1782607641.679044:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9745776b7b80 x1869199364382848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607657 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782607641.679103:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745776b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364382848:0@lo:13:osp-pre-1-0.0 10000000:01000000:0.0:1782607641.730170:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782607641.730182:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff97457f5e0000 from 7 10000000:01000000:0.0:1782607641.730189:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782607641.730257:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974546c43000/0x8109266df35cb378 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607641.730271:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974546c43000/0x8109266df35cb378 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607641.730350:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974546c43000/0x8109266df35cb378 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607641.730389:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457718ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364382976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782607641.730504:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607641.730652:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff97456dcd4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1782607641.734538:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364382976 00000100:00100000:3.0:1782607641.734993:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364382976 00000100:00100000:3.0:1782607641.735196:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1782607641.735210:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+16:5800:x1869199364382976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782607641.735234:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607641.735258:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97455d648a00/0x8109266df35cb37f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cb378 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607641.735295:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97455d648a00/0x8109266df35cb37f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cb378 expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607641.735309:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97455d648a00/0x8109266df35cb37f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cb378 expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607641.735320:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97455d648a00, rc 0) 00000100:00100000:3.0:1782607641.735443:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+17:5800:x1869199364382976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 237us (4941us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607641.735451:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1782607641.735577:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457718ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364382976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782607641.735600:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974546c43000/0x8109266df35cb378 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb37f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607641.735611:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974546c43000/0x8109266df35cb378 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cb37f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607641.735707:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457718ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364383104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782607641.735752:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607641.737626:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff97456dcd4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1782607641.737727:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364383104 00000100:00100000:1.0:1782607641.737742:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364383104 00000100:00100000:1.0:1782607641.737862:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1782607641.737873:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+17:5800:x1869199364383104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782607641.738438:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+17:5800:x1869199364383104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 565us (2684us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607641.738447:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1782607641.738873:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457718ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364383104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782607641.739038:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457718ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364383232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782607641.739098:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607641.739252:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff97456dcd4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1782607641.739360:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364383232 00000100:00100000:1.0:1782607641.739366:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364383232 00000100:00100000:1.0:1782607641.739457:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1782607641.739467:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+17:5800:x1869199364383232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782607641.739673:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+17:5800:x1869199364383232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 208us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607641.739680:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1782607641.739762:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457718ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364383232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782607641.740833:0:11558:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457718ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:11558:1869199364383360:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782607641.740912:0:11558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607641.741252:0:11558:0:(client.c:2701:ptlrpc_set_wait()) set ffff97455d443540 going to sleep for 11 seconds 00000100:00100000:3.0:1782607641.741422:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364383360 00000100:00100000:3.0:1782607641.741430:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364383360 00000100:00100000:3.0:1782607641.741469:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1782607641.741479:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+17:11558:x1869199364383360:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782607641.741736:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+17:11558:x1869199364383360:12345-0@lo:502:llog_process_th.0 Request processed in 259us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607641.741742:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1782607641.748474:0:11558:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457718ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:11558:1869199364383360:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782607641.748544:0:11558:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782607641.748562:0:11558:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782607641.748565:0:11558:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1782607641.748575:0:11558:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97457f5e0000 00000020:00000080:0.0:1782607641.748578:0:11558:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1782607641.748734:0:11558:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457718ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:11558:1869199364383488:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782607641.748906:0:11558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607641.748952:0:11558:0:(client.c:2701:ptlrpc_set_wait()) set ffff97455d443540 going to sleep for 11 seconds 00000100:00100000:2.0:1782607641.749429:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364383488 00000100:00100000:2.0:1782607641.749438:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364383488 00000100:00100000:2.0:1782607641.749507:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1782607641.749519:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+17:11558:x1869199364383488:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782607641.751186:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+17:11558:x1869199364383488:12345-0@lo:502:llog_process_th.0 Request processed in 1660us (2272us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607641.751203:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1782607641.754476:0:11558:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457718ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:11558:1869199364383488:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782607641.754538:0:11558:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782607641.754550:0:11558:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782607641.754553:0:11558:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1782607641.754558:0:11558:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1782607641.755406:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1782607641.755438:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782607641.755455:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974546c43000/0x8109266df35cb378 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb37f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607641.755470:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974546c43000/0x8109266df35cb378 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb37f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782607641.755484:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782607641.755488:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff97455053f000 from 7 10000000:01000000:3.0:1782607641.755491:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782607641.755542:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97455d648600/0x8109266df35cb386 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607641.755551:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff97455d648600/0x8109266df35cb386 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607641.755563:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff97455d648600/0x8109266df35cb386 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607641.755594:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745776b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364383616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782607641.755680:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607641.755721:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745486eb600 going to sleep for 11 seconds 00000100:00100000:1.0:1782607641.759489:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364383616 00000100:00100000:1.0:1782607641.759509:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364383616 00000100:00100000:1.0:1782607641.759592:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1782607641.759604:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+17:5800:x1869199364383616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782607641.759627:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607641.759651:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97457f467400/0x8109266df35cb38d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cb386 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607641.759705:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97457f467400/0x8109266df35cb38d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cb386 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607641.759719:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97457f467400/0x8109266df35cb38d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cb386 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607641.759730:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97457f467400, rc 0) 00000100:00100000:1.0:1782607641.759868:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+18:5800:x1869199364383616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 266us (4188us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607641.759876:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1782607641.759945:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745776b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364383616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782607641.759967:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff97455d648600/0x8109266df35cb386 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb38d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607641.759978:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff97455d648600/0x8109266df35cb386 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cb38d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607641.760074:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97454773b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364383744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782607641.760113:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607641.760150:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745812d7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782607641.760165:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364383744 00000100:00100000:1.0:1782607641.760169:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364383744 00000100:00100000:1.0:1782607641.760191:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1782607641.760198:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+18:5800:x1869199364383744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782607641.760508:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+18:5800:x1869199364383744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 309us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607641.760526:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1782607641.760563:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97454773b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364383744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782607641.760594:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97454773b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364383872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782607641.760637:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607641.760650:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745812d7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782607641.760662:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364383872 00000100:00100000:1.0:1782607641.760665:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364383872 00000100:00100000:1.0:1782607641.760681:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1782607641.760686:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974550829850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+18:5800:x1869199364383872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782607641.760885:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974550829850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+18:5800:x1869199364383872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 198us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607641.760892:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1782607641.760929:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97454773b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364383872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782607641.761138:0:11561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97454773b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:11561:1869199364384000:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782607641.761171:0:11561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607641.761190:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364384000 00000100:00100000:1.0:1782607641.761194:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364384000 00000100:00100000:1.0:1782607641.761213:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1782607641.761219:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974550829050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+18:11561:x1869199364384000:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782607641.761338:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974550829050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+18:11561:x1869199364384000:12345-0@lo:502:llog_process_th.0 Request processed in 119us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607641.761344:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1782607641.761370:0:11561:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745511a4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1782607641.761383:0:11561:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97454773b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:11561:1869199364384000:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782607641.761425:0:11561:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782607641.761436:0:11561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782607641.761439:0:11561:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1782607641.761449:0:11561:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97455053f000 00000020:00000080:1.0:1782607641.761451:0:11561:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1782607641.761536:0:11561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97454773b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:11561:1869199364384128:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782607641.761565:0:11561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607641.761580:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364384128 00000100:00100000:1.0:1782607641.761583:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364384128 00000100:00100000:1.0:1782607641.761602:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1782607641.761608:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+18:11561:x1869199364384128:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782607641.761697:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+18:11561:x1869199364384128:12345-0@lo:502:llog_process_th.0 Request processed in 89us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607641.763634:0:11561:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745511a4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1782607641.763704:0:11561:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97454773b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:11561:1869199364384128:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782607641.763761:0:11561:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782607641.763802:0:11561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782607641.763819:0:11561:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1782607641.763824:0:11561:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1782607641.764059:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1782607641.764081:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782607641.764096:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97455d648600/0x8109266df35cb386 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb38d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607641.764111:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff97455d648600/0x8109266df35cb386 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb38d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782607641.764126:0:5800:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782607641.764129:0:5800:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff974544151000 from 7 10000000:01000000:0.0:1782607641.764132:0:5800:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782607641.764177:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974546c43c00/0x8109266df35cb394 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607641.764186:0:5800:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974546c43c00/0x8109266df35cb394 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607641.764197:0:5800:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974546c43c00/0x8109266df35cb394 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607641.764222:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457718ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364384256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782607641.764308:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607641.764334:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff97455d443540 going to sleep for 11 seconds 00000100:00100000:0.0:1782607641.764355:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364384256 00000100:00100000:0.0:1782607641.764362:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364384256 00000100:00100000:1.0:1782607641.766072:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1782607641.774518:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1782607641.774558:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+18:5800:x1869199364384256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782607641.774584:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607641.774636:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974546c43600/0x8109266df35cb39b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cb394 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607641.774676:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974546c43600/0x8109266df35cb39b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cb394 expref: 19 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607641.774689:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974546c43600/0x8109266df35cb39b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cb394 expref: 19 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607641.774699:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c43600, rc 0) 00000100:00100000:1.0:1782607641.774935:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457718ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364384256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782607641.774958:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974546c43c00/0x8109266df35cb394 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb39b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607641.774970:0:5800:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974546c43c00/0x8109266df35cb394 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cb39b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607641.775070:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974547738e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364384384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782607641.775133:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607641.775170:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745511a4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782607641.775186:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364384384 00000100:00100000:1.0:1782607641.775193:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364384384 00000100:00100000:1.0:1782607641.775223:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1782607641.775240:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974550829450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+20:5800:x1869199364384384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782607641.775442:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+19:5800:x1869199364384256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 362us (10588us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607641.775451:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1782607641.775566:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974550829450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+19:5800:x1869199364384384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 327us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607641.775573:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1782607641.775618:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974547738e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364384384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782607641.775668:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974547738e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364384512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782607641.775707:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607641.775723:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745511a4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782607641.775752:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364384512 00000100:00100000:1.0:1782607641.775756:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364384512 00000100:00100000:1.0:1782607641.775795:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1782607641.775802:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+19:5800:x1869199364384512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782607641.775970:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+19:5800:x1869199364384512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 168us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607641.775976:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1782607641.776011:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974547738e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fae11c6e-4506-4104-bb8c-df42498f7e08:5800:1869199364384512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782607641.781732:0:11562:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974547738e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:11562:1869199364384640:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782607641.781882:0:11562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607641.781938:0:11562:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745812d7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782607641.785149:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364384640 00000100:00100000:0.0:1782607641.785172:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364384640 00000100:00100000:0.0:1782607641.785263:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1782607641.785276:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974550828850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+19:11562:x1869199364384640:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782607641.785671:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974550828850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+19:11562:x1869199364384640:12345-0@lo:502:llog_process_th.0 Request processed in 397us (3788us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607641.785679:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1782607641.786165:0:11562:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974547738e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:11562:1869199364384640:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782607641.786213:0:11562:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782607641.786226:0:11562:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782607641.786228:0:11562:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1782607641.786239:0:11562:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff974544151000 00000020:00000080:1.0:1782607641.786250:0:11562:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1782607641.786390:0:11562:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974547738e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:11562:1869199364384768:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782607641.786456:0:11562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607641.786491:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364384768 00000100:00100000:1.0:1782607641.786497:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364384768 00000100:00100000:1.0:1782607641.786533:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1782607641.786540:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+19:11562:x1869199364384768:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782607641.786716:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+19:11562:x1869199364384768:12345-0@lo:502:llog_process_th.0 Request processed in 175us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607641.786723:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1782607641.786798:0:11562:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745511a4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782607641.786814:0:11562:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974547738e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fae11c6e-4506-4104-bb8c-df42498f7e08:11562:1869199364384768:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782607641.786834:0:11562:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782607641.786839:0:11562:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782607641.786841:0:11562:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1782607641.786846:0:11562:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1782607641.787274:0:5800:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1782607641.787307:0:5800:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782607641.787320:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974546c43c00/0x8109266df35cb394 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb39b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607641.787333:0:5800:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974546c43c00/0x8109266df35cb394 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb39b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782607641.794098:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1782607641.796686:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782607642.690188:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782607642.690221:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457718c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364384896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782607642.690332:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607642.690576:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364384896 00000100:00100000:0.0:1782607642.690595:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364384896 00000100:00100000:0.0:1782607642.690656:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1782607642.690666:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745776b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364384896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782607642.690720:0:6612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782607642.690811:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745776b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364384896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607642.690830:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1782607642.690993:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457718c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364384896:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1782607642.818914:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1782607642.819170:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607643.845791:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782607644.226739:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364385408:0@lo:400:kworker.0 00000100:00100000:2.0:1782607644.226865:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607644.226946:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782607644.226952:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567327b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1869199364385280:0@lo:400:kworker.0 00000100:00100000:2.0:1782607644.226998:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607644.227157:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fae11c6e-4506-4104-bb8c-df42498f7e08:3318:1869199364385024:0@lo:400:kworker.0 00000100:00100000:0.0:1782607644.227204:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607644.227241:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1869199364385536:0@lo:400:kworker.0 00000100:00100000:0.0:1782607644.227276:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607644.227299:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782607644.227305:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567326a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1869199364385152:0@lo:400:kworker.0 00000100:00100000:0.0:1782607644.227328:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607644.227345:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364385664:0@lo:400:kworker.0 00000100:00100000:0.0:1782607644.227367:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607644.227414:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364385408 00000100:00100000:0.0:1782607644.227424:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364385408 00000100:00100000:0.0:1782607644.227489:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364385664 00000100:00100000:0.0:1782607644.227493:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364385664 00000100:00100000:0.0:1782607644.227518:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1782607644.227527:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458153b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364385408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607644.227596:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458153b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364385408:12345-0@lo:400:kworker.0 Request processed in 69us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607644.227604:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1782607644.227623:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1782607644.227629:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457718c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364385664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607644.227662:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457718c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364385664:12345-0@lo:400:kworker.0 Request processed in 33us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607644.227668:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1782607644.227696:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364385280 00000100:00100000:0.0:1782607644.227701:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364385280 00000100:00100000:0.0:1782607644.227741:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364385536 00000100:00100000:0.0:1782607644.227744:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364385536 00000100:00100000:0.0:1782607644.227758:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364385152 00000100:00100000:0.0:1782607644.227760:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364385152 00000100:00100000:0.0:1782607644.227805:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1782607644.227812:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581539880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869199364385280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607644.227843:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581539880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869199364385280:12345-0@lo:400:kworker.0 Request processed in 32us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607644.227849:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1782607644.227859:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1782607644.227864:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457718c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869199364385536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607644.227888:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457718c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869199364385536:12345-0@lo:400:kworker.0 Request processed in 25us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607644.227893:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1782607644.227901:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1782607644.227906:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457718ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1869199364385152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607644.227930:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457718ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1869199364385152:12345-0@lo:400:kworker.0 Request processed in 24us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607644.227935:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:0.0:1782607644.227968:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782607644.227974:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782607644.227976:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782607644.228026:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567326a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1869199364385152:0@lo:400:kworker.0 00010000:00080000:0.0:1782607644.228042:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974567324a80 x1869199364385664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782607644.228066:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364385664:0@lo:400:kworker.0 00000100:00100000:0.0:1782607644.228080:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1869199364385536:0@lo:400:kworker.0 00000100:00100000:0.0:1782607644.228119:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567327b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1869199364385280:0@lo:400:kworker.0 00000100:00100000:0.0:1782607644.228130:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364385408:0@lo:400:kworker.0 00000100:00100000:2.0:1782607644.228761:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364385024 00000100:00100000:2.0:1782607644.228800:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364385024 00000100:00100000:2.0:1782607644.228858:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1782607644.228868:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974550828450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3318:x1869199364385024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607644.228941:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974550828450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3318:x1869199364385024:12345-0@lo:400:kworker.0 Request processed in 75us (1736us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607644.228948:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1782607644.231354:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fae11c6e-4506-4104-bb8c-df42498f7e08:3318:1869199364385024:0@lo:400:kworker.0 00010000:00010000:0.0:1782607644.869335:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607645.892875:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607645.934709:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607645.934824:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607645.934852:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607645.934893:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607645.934947:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342329344 00000100:00100000:1.0:1782607645.934961:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342329344 00000100:00100000:1.0:1782607645.935041:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342329600 00000100:00100000:1.0:1782607645.935045:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342329600 00000100:00100000:1.0:1782607645.935076:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 114 00000100:00100000:1.0:1782607645.935088:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974547738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2356:x1869199342329344:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1782607645.935197:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974547738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2356:x1869199342329344:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 111us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607645.935227:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 114 00000100:00100000:1.0:1782607645.935251:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 115 00000100:00100000:1.0:1782607645.935257:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974547738380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2356:x1869199342329600:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1782607645.935287:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974547738380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2356:x1869199342329600:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 30us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607645.935293:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 115 00000100:00080000:3.0:1782607645.935607:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782607645.935807:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342329472 00000100:00100000:0.0:1782607645.935814:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342329472 00000100:00100000:0.0:1782607645.935857:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 66 00000100:00100000:0.0:1782607645.935866:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974547738e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2356:x1869199342329472:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1782607645.935911:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974547738e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2356:x1869199342329472:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 47us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607645.935918:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 66 00000100:00080000:3.0:1782607645.935989:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782607645.936133:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342329216 00000100:00100000:2.0:1782607645.936138:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342329216 00000100:00100000:2.0:1782607645.936185:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 278 00000100:00100000:2.0:1782607645.936193:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2356:x1869199342329216:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607645.936226:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2356:x1869199342329216:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 34us (1537us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607645.936233:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 278 00000100:00100000:2.0:1782607646.786394:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782607646.786430:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745776b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364385792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782607646.786554:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607646.786716:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364385792 00000100:00100000:1.0:1782607646.786743:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364385792 00000100:00080000:3.0:1782607646.786875:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782607646.786902:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1782607646.786917:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581539c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364385792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782607646.786963:0:6612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782607646.787067:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581539c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364385792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607646.787074:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1782607646.788061:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9745776b7480 x1869199364385792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607662 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607646.788098:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745776b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364385792:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782607646.914152:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607647.811237:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782607647.811282:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457718d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364385920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782607647.811403:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607647.811979:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364385920 00000100:00100000:0.0:1782607647.811991:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364385920 00000100:00100000:0.0:1782607647.812094:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1782607647.812106:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974547738a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364385920:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782607647.812248:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1782607647.812368:0:6612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782607647.812449:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974547738a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364385920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 345us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607647.812457:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1782607647.812814:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457718d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364385920:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782607647.938091:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607648.964026:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782607649.346208:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745776b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364386432:0@lo:400:kworker.0 00000100:00100000:3.0:1782607649.346313:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607649.346404:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782607649.346411:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745776b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1869199364386304:0@lo:400:kworker.0 00000100:00100000:3.0:1782607649.346442:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607649.347244:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745776b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fae11c6e-4506-4104-bb8c-df42498f7e08:3318:1869199364386048:0@lo:400:kworker.0 00000100:00100000:0.0:1782607649.347304:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607649.347365:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745776b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1869199364386560:0@lo:400:kworker.0 00000100:00100000:0.0:1782607649.347392:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607649.347423:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782607649.347431:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745776b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1869199364386176:0@lo:400:kworker.0 00000100:00100000:0.0:1782607649.347456:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607649.347475:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745776b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364386688:0@lo:400:kworker.0 00000100:00100000:0.0:1782607649.347502:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607649.347542:0:9088:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364386432 00000100:00100000:0.0:1782607649.347552:0:9088:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364386432 00000100:00100000:2.0:1782607649.347686:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364386048 00000100:00100000:2.0:1782607649.347691:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364386048 00000100:00100000:2.0:1782607649.347747:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1782607649.347758:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3318:x1869199364386048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607649.347862:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3318:x1869199364386048:12345-0@lo:400:kworker.0 Request processed in 105us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607649.347870:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00080000:2.0:1782607649.347939:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782607649.347973:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364386688 00000100:00100000:2.0:1782607649.347977:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364386688 00000100:00100000:2.0:1782607649.348011:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1782607649.348018:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457718ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364386688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607649.348054:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457718ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364386688:12345-0@lo:400:kworker.0 Request processed in 36us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607649.348060:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1782607649.348075:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782607649.348241:0:9088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1782607649.348248:0:9088:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745776b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364386432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607649.348290:0:9088:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745776b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364386432:12345-0@lo:400:kworker.0 Request processed in 43us (1978us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607649.348296:0:9088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:2.0:1782607649.348380:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9745776b4a80 x1869199364386688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782607649.348397:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745776b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364386688:0@lo:400:kworker.0 00000100:00100000:2.0:1782607649.348413:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745776b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fae11c6e-4506-4104-bb8c-df42498f7e08:3318:1869199364386048:0@lo:400:kworker.0 00000100:00100000:3.0:1782607649.348616:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364386304 00000100:00100000:3.0:1782607649.348622:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364386304 00000100:00100000:3.0:1782607649.348673:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364386560 00000100:00100000:3.0:1782607649.348677:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364386560 00000100:00100000:3.0:1782607649.348693:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364386176 00000100:00100000:3.0:1782607649.348696:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364386176 00000100:00100000:3.0:1782607649.348711:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1782607649.348718:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745776b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869199364386304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607649.348797:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745776b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869199364386304:12345-0@lo:400:kworker.0 Request processed in 79us (2353us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607649.348804:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1782607649.348821:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1782607649.348827:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457718e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869199364386560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607649.348864:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457718e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869199364386560:12345-0@lo:400:kworker.0 Request processed in 37us (1471us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607649.348882:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1782607649.348893:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1782607649.348899:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457718d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1869199364386176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607649.348933:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457718d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1869199364386176:12345-0@lo:400:kworker.0 Request processed in 34us (1477us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607649.348939:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1782607649.348980:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745776b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1869199364386304:0@lo:400:kworker.0 00000100:00100000:3.0:1782607649.348994:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745776b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364386432:0@lo:400:kworker.0 00000100:00100000:3.0:1782607649.349042:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745776b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1869199364386176:0@lo:400:kworker.0 00000100:00100000:3.0:1782607649.349056:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745776b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1869199364386560:0@lo:400:kworker.0 00000100:00080000:2.0:1782607649.349378:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782607649.986324:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607651.011395:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607651.051878:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607651.051923:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607651.051967:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607651.052005:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607651.052107:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342329856 00000100:00100000:2.0:1782607651.052123:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342329856 00000100:00100000:2.0:1782607651.052205:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342330112 00000100:00100000:2.0:1782607651.052209:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342330112 00000100:00100000:2.0:1782607651.052234:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 119 00000100:00100000:2.0:1782607651.052246:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974547738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2357:x1869199342329856:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607651.052364:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974547738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2357:x1869199342329856:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 119us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607651.052378:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 119 00000100:00100000:2.0:1782607651.052401:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 120 00000100:00100000:2.0:1782607651.052409:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974547739180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2357:x1869199342330112:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607651.052435:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974547739180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2357:x1869199342330112:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 28us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607651.052464:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 120 00000100:00100000:2.0:1782607651.052486:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342329984 00000100:00100000:2.0:1782607651.052490:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342329984 00000100:00100000:2.0:1782607651.052531:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 69 00000100:00100000:2.0:1782607651.052538:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97454773a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2357:x1869199342329984:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607651.052571:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97454773a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2357:x1869199342329984:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 33us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607651.052577:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 69 00000100:00080000:1.0:1782607651.052824:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782607651.052831:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782607651.053106:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342329728 00000100:00100000:0.0:1782607651.053112:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342329728 00000100:00100000:0.0:1782607651.053160:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 280 00000100:00100000:0.0:1782607651.053169:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2357:x1869199342329728:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1782607651.053216:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2357:x1869199342329728:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 48us (1248us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607651.053224:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 280 00000100:00100000:2.0:1782607651.907094:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745776b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364386816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782607651.907211:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607651.911326:0:6613:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364386816 00000100:00100000:1.0:1782607651.911375:0:6613:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364386816 00000100:00100000:1.0:1782607651.911507:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1782607651.911529:0:6613:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458153ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364386816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782607651.911597:0:6613:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782607651.911737:0:6613:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458153ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364386816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 220us (4526us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607651.911746:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1782607651.911959:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9745776b4380 x1869199364386816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607667 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607651.911992:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745776b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364386816:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1782607651.912439:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:2.0:1782607652.034574:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1782607652.035076:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782607652.930688:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782607652.937054:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457718d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364386944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782607652.937188:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607652.938083:0:6613:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364386944 00000100:00100000:1.0:1782607652.938098:0:6613:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364386944 00000100:00100000:1.0:1782607652.938206:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1782607652.938220:0:6613:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458153aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364386944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782607652.938275:0:6613:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782607652.938382:0:6613:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458153aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364386944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 164us (1195us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607652.938390:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1782607652.938586:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457718d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364386944:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782607652.939242:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782607653.060207:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607654.082132:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782607654.466264:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457718d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364387456:0@lo:400:kworker.0 00000100:00100000:0.0:1782607654.466427:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607654.466520:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782607654.466527:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457718df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1869199364387328:0@lo:400:kworker.0 00000100:00100000:0.0:1782607654.466558:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607654.466598:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364387456 00000100:00100000:0.0:1782607654.466607:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364387456 00000100:00100000:0.0:1782607654.466678:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1782607654.466689:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974567327b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364387456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607654.466798:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974567327b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364387456:12345-0@lo:400:kworker.0 Request processed in 111us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607654.466806:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1782607654.466862:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457718d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364387456:0@lo:400:kworker.0 00000100:00100000:2.0:1782607654.467080:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364387328 00000100:00100000:2.0:1782607654.467085:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364387328 00000100:00100000:2.0:1782607654.467133:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1782607654.467143:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974567324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869199364387328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607654.467187:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974567324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869199364387328:12345-0@lo:400:kworker.0 Request processed in 45us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607654.467193:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:2.0:1782607654.467214:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782607654.467219:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782607654.467609:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457718df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1869199364387328:0@lo:400:kworker.0 00000100:00100000:1.0:1782607654.467699:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457718ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1869199364387200:0@lo:400:kworker.0 00000100:00100000:1.0:1782607654.467755:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607654.467815:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364387712:0@lo:400:kworker.0 00000100:00100000:1.0:1782607654.467841:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607654.467880:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1782607654.467887:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457718c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364387072:0@lo:400:kworker.0 00000100:00100000:1.0:1782607654.467916:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607654.467937:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1869199364387584:0@lo:400:kworker.0 00000100:00100000:1.0:1782607654.467958:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607654.468047:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364387200 00000100:00100000:3.0:1782607654.468053:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364387200 00000100:00100000:3.0:1782607654.468101:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364387584 00000100:00100000:3.0:1782607654.468104:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364387584 00000100:00100000:3.0:1782607654.468137:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1782607654.468145:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97454773b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1869199364387200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607654.468206:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97454773b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1869199364387200:12345-0@lo:400:kworker.0 Request processed in 62us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607654.468212:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1782607654.468247:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1782607654.468253:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97454773b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1869199364387584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607654.468285:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97454773b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1869199364387584:12345-0@lo:400:kworker.0 Request processed in 32us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607654.468292:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1782607654.468338:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1869199364387584:0@lo:400:kworker.0 00000100:00100000:3.0:1782607654.468350:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457718ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1869199364387200:0@lo:400:kworker.0 00000100:00100000:2.0:1782607654.468612:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364387712 00000100:00100000:2.0:1782607654.468625:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364387712 00000100:00100000:2.0:1782607654.468670:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1782607654.468678:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97454773b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364387712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607654.468742:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97454773b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364387712:12345-0@lo:400:kworker.0 Request processed in 64us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607654.468748:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1782607654.468816:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364387072 00000100:00100000:2.0:1782607654.468820:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364387072 00000100:00100000:2.0:1782607654.468847:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1782607654.468854:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974550829c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3319:x1869199364387072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607654.468885:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974550829c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3319:x1869199364387072:12345-0@lo:400:kworker.0 Request processed in 31us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607654.468892:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00080000:2.0:1782607654.468920:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782607654.468925:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782607654.469013:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457718c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364387072:0@lo:400:kworker.0 00010000:00080000:1.0:1782607654.469030:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974567326d80 x1869199364387712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607670 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607654.469051:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364387712:0@lo:400:kworker.0 00010000:00010000:0.0:1782607655.106624:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607656.132607:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607656.170184:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607656.170237:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607656.170451:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342330240 00000100:00100000:2.0:1782607656.170466:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342330240 00000100:00100000:2.0:1782607656.170686:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 282 00000100:00100000:2.0:1782607656.170701:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455082ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2355:x1869199342330240:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607656.170850:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455082ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2355:x1869199342330240:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 151us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607656.170859:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 282 00000100:00100000:3.0:1782607656.170942:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342330368 00000100:00100000:3.0:1782607656.170947:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342330368 00000100:00100000:3.0:1782607656.170999:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 124 00000100:00100000:3.0:1782607656.171007:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97454773ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2355:x1869199342330368:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1782607656.171048:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97454773ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2355:x1869199342330368:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 42us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607656.171055:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 124 00000100:00080000:3.0:1782607656.171099:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782607656.181527:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607656.181938:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342330496 00000100:00100000:0.0:1782607656.181953:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342330496 00000100:00100000:0.0:1782607656.182046:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 19 00000100:00100000:0.0:1782607656.182059:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745776b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2353:x1869199342330496:12345-192.168.202.4@tcp:9:kworker.0 00000020:00000080:0.0:1782607656.182102:0:6609:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8109266df35cb2d7 00000100:00080000:0.0:1782607656.182113:0:6609:0:(import.c:65:import_set_state_nolock()) ffff974548911000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782607656.182160:0:6609:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1782607656.182622:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745776b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+2:2353:x1869199342330496:12345-192.168.202.4@tcp:9:kworker.0 Request processed in 565us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607656.182653:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 19 00010000:00010000:0.0:1782607656.182687:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782607656.182843:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607656.182933:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342330624 00000100:00100000:0.0:1782607656.182938:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342330624 00000100:00100000:0.0:1782607656.182979:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 125 00000100:00100000:0.0:1782607656.182987:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974567324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2354:x1869199342330624:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1782607656.183028:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974567324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2354:x1869199342330624:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 41us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607656.183034:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 125 00000100:00080000:3.0:1782607656.183205:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782607656.183211:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782607657.026138:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782607657.026182:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745776b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364387840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782607657.026292:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607657.026462:0:6613:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364387840 00000100:00100000:1.0:1782607657.026472:0:6613:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364387840 00000100:00100000:1.0:1782607657.026551:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1782607657.026563:0:6613:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974567326a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364387840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782607657.026612:0:6613:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782607657.026677:0:6613:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974567326a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364387840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607657.026685:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1782607657.026742:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9745776b7800 x1869199364387840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607673 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607657.026796:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745776b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364387840:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1782607657.027051:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1782607657.154130:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782607658.050205:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782607658.050237:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364387968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782607658.050338:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607658.050402:0:6613:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364387968 00000100:00100000:1.0:1782607658.050411:0:6613:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364387968 00000100:00080000:3.0:1782607658.050478:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782607658.050486:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1782607658.050498:0:6613:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97454894b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364387968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782607658.050537:0:6613:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782607658.050598:0:6613:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97454894b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364387968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607658.050606:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782607658.050931:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364387968:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782607658.178126:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607659.202339:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1782607659.212793:0:6634:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d72d7fb9-639f-4ad9-b658-df715cbf7792 00000020:00000080:1.0:1782607659.212807:0:6634:0:(genops.c:906:class_export_put()) final put ffff974548915000/d72d7fb9-639f-4ad9-b658-df715cbf7792 00000020:00000080:0.0:1782607659.213219:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff974548915000/d72d7fb9-639f-4ad9-b658-df715cbf7792 for lustre-OST0000 00000020:00000080:0.0:1782607659.219926:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff974548911000 for lustre-OST0000 00000100:00100000:1.0:1782607659.586236:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1869199364388224:0@lo:400:kworker.0 00000100:00100000:1.0:1782607659.586370:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607659.586455:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457718d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364388736:0@lo:400:kworker.0 00000100:00100000:1.0:1782607659.586486:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607659.586527:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1782607659.586535:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364388096:0@lo:400:kworker.0 00000100:00100000:1.0:1782607659.586568:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607659.586599:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457718df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1869199364388608:0@lo:400:kworker.0 00000100:00100000:1.0:1782607659.586623:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607659.586654:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457718ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364388480:0@lo:400:kworker.0 00000100:00100000:1.0:1782607659.586681:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607659.586700:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782607659.586705:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457718c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1869199364388352:0@lo:400:kworker.0 00000100:00100000:1.0:1782607659.586725:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607659.586757:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364388736 00000100:00100000:1.0:1782607659.586798:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364388736 00000100:00100000:1.0:1782607659.586866:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364388480 00000100:00100000:1.0:1782607659.586870:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364388480 00000100:00100000:1.0:1782607659.586894:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782607659.586904:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974547739c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364388736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607659.586969:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974547739c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364388736:12345-0@lo:400:kworker.0 Request processed in 66us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607659.586977:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782607659.587000:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1782607659.587006:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97454773a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364388480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607659.587038:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97454773a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364388480:12345-0@lo:400:kworker.0 Request processed in 31us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607659.587065:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1782607659.587087:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364388096 00000100:00100000:1.0:1782607659.587091:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364388096 00000100:00100000:1.0:1782607659.587114:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1782607659.587121:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974550828c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3319:x1869199364388096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607659.587152:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974550828c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3319:x1869199364388096:12345-0@lo:400:kworker.0 Request processed in 32us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607659.587159:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1782607659.587190:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364388224 00000100:00100000:1.0:1782607659.587194:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364388224 00000100:00100000:1.0:1782607659.587216:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364388608 00000100:00100000:1.0:1782607659.587219:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364388608 00000100:00100000:1.0:1782607659.587232:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364388352 00000100:00100000:1.0:1782607659.587233:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364388352 00000100:00100000:1.0:1782607659.587247:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1782607659.587265:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974547739500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1869199364388224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607659.587297:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974547739500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1869199364388224:12345-0@lo:400:kworker.0 Request processed in 44us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607659.587304:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1782607659.587315:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1782607659.587320:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97454773bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1869199364388608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607659.587347:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97454773bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1869199364388608:12345-0@lo:400:kworker.0 Request processed in 27us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607659.587353:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1782607659.587364:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1782607659.587369:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974547739f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869199364388352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607659.587409:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974547739f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869199364388352:12345-0@lo:400:kworker.0 Request processed in 40us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607659.587415:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:1.0:1782607659.587445:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782607659.587450:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782607659.587485:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457718c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1869199364388352:0@lo:400:kworker.0 00000100:00100000:1.0:1782607659.587497:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457718ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364388480:0@lo:400:kworker.0 00000100:00100000:1.0:1782607659.587531:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364388096:0@lo:400:kworker.0 00000100:00100000:1.0:1782607659.587541:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457718df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1869199364388608:0@lo:400:kworker.0 00000100:00100000:1.0:1782607659.587551:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1869199364388224:0@lo:400:kworker.0 00010000:00080000:1.0:1782607659.587563:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97457718d180 x1869199364388736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607659.587575:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457718d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364388736:0@lo:400:kworker.0 00010000:00010000:3.0:1782607660.226088:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607661.250060:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607661.292569:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607661.292634:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607661.292675:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342330880 00000100:00100000:1.0:1782607661.292688:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342330880 00000100:00100000:1.0:1782607661.292804:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 129 00000100:00100000:1.0:1782607661.292819:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974567326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2354:x1869199342330880:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1782607661.292923:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974567326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2354:x1869199342330880:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 108us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607661.292932:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 129 00000100:00080000:1.0:1782607661.292961:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782607661.293342:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342330752 00000100:00100000:3.0:1782607661.293350:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342330752 00000100:00100000:3.0:1782607661.293390:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 284 00000100:00100000:3.0:1782607661.293399:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974550828050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2354:x1869199342330752:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1782607661.293435:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974550828050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2354:x1869199342330752:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 37us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607661.293453:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 284 00000100:00100000:2.0:1782607661.307755:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607661.307989:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342331008 00000100:00100000:0.0:1782607661.308003:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342331008 00000100:00100000:0.0:1782607661.308113:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 130 00000100:00100000:0.0:1782607661.308134:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974548949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2355:x1869199342331008:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1782607661.308249:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974548949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2355:x1869199342331008:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 117us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607661.308259:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 130 00000100:00080000:2.0:1782607661.309728:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782607662.146315:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782607662.146344:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457718d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364388864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782607662.146423:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607662.146494:0:6613:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364388864 00000100:00100000:2.0:1782607662.146510:0:6613:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364388864 00000100:00100000:2.0:1782607662.146616:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782607662.146628:0:6613:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457718df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364388864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782607662.146689:0:6613:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782607662.146820:0:6613:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457718df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364388864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 193us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607662.146830:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1782607662.147026:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1782607662.147093:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97457718d180 x1869199364388864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607678 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782607662.147121:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457718d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364388864:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1782607662.278485:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1782607662.278976:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607663.181861:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974567326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364388992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782607663.181994:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607663.182096:0:6613:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364388992 00000100:00100000:1.0:1782607663.182106:0:6613:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364388992 00000100:00100000:1.0:1782607663.182213:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1782607663.182234:0:6613:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974578da9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364388992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782607663.182288:0:6613:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782607663.182343:0:6613:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974578da9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364388992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607663.182352:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1782607663.182376:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782607663.182418:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974567326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364388992:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782607663.298979:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607664.322008:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782607664.706152:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974548948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364389504:0@lo:400:kworker.0 00000100:00100000:3.0:1782607664.706246:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97454894bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fae11c6e-4506-4104-bb8c-df42498f7e08:3318:1869199364389120:0@lo:400:kworker.0 00000100:00100000:2.0:1782607664.706265:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607664.706352:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974548948000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1869199364389248:0@lo:400:kworker.0 00000100:00100000:0.0:1782607664.706403:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974548949880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1869199364389376:0@lo:400:kworker.0 00000100:00100000:2.0:1782607664.706678:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364389504 00000100:00100000:2.0:1782607664.706699:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364389504 00000100:00100000:2.0:1782607664.706761:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1782607664.706792:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455d462300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364389504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607664.706861:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455d462300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364389504:12345-0@lo:400:kworker.0 Request processed in 72us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607664.706868:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1782607664.706923:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974548948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364389504:0@lo:400:kworker.0 00000100:00100000:3.0:1782607664.713316:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607664.713420:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97454894aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1869199364389632:0@lo:400:kworker.0 00000100:00100000:3.0:1782607664.713505:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607664.713580:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364389120 00000100:00100000:3.0:1782607664.713591:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364389120 00000100:00100000:3.0:1782607664.714273:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1782607664.714294:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3318:x1869199364389120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607664.714379:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3318:x1869199364389120:12345-0@lo:400:kworker.0 Request processed in 94us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607664.714387:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1782607664.714537:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97454894bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fae11c6e-4506-4104-bb8c-df42498f7e08:3318:1869199364389120:0@lo:400:kworker.0 00000100:00100000:3.0:1782607664.716358:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364389632 00000100:00100000:3.0:1782607664.716377:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364389632 00000100:00100000:3.0:1782607664.716462:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1782607664.716476:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745776b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869199364389632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607664.716585:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745776b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869199364389632:12345-0@lo:400:kworker.0 Request processed in 114us (3079us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607664.716591:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:3.0:1782607664.716614:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782607664.717306:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97454894aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1869199364389632:0@lo:400:kworker.0 00000100:00100000:0.0:1782607664.719300:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607664.722261:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607664.730988:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364389760:0@lo:400:kworker.0 00000100:00100000:3.0:1782607664.731089:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607664.732481:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364389760 00000100:00100000:3.0:1782607664.732497:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364389760 00000100:00100000:3.0:1782607664.732580:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1782607664.732593:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745776b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364389760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607664.732705:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745776b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364389760:12345-0@lo:400:kworker.0 Request processed in 114us (1617us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607664.732713:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1782607664.732740:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1782607664.732803:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97455d461880 x1869199364389760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607664.732821:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364389760:0@lo:400:kworker.0 00000100:00100000:1.0:1782607664.738945:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364389376 00000100:00100000:1.0:1782607664.738963:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364389376 00000100:00100000:1.0:1782607664.739064:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364389248 00000100:00100000:1.0:1782607664.739067:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364389248 00000100:00100000:1.0:1782607664.739107:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1782607664.739121:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457718d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869199364389376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607664.739273:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457718d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869199364389376:12345-0@lo:400:kworker.0 Request processed in 154us (19981us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607664.739281:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1782607664.739300:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1782607664.739306:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745776b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1869199364389248:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1782607664.739495:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782607664.739543:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745776b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1869199364389248:12345-0@lo:400:kworker.0 Request processed in 237us (17297us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607664.739567:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1782607664.739633:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974548948000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1869199364389248:0@lo:400:kworker.0 00000100:00100000:1.0:1782607664.739798:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974548949880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1869199364389376:0@lo:400:kworker.0 00000001:02000400:0.0:1782607665.216315:0:11727:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 20:47:44 (1782607664) 00010000:00010000:0.0:1782607665.348790:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607666.370457:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607666.410474:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607666.410529:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607666.410670:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342331136 00000100:00100000:3.0:1782607666.410684:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342331136 00000100:00100000:3.0:1782607666.410798:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 286 00000100:00100000:3.0:1782607666.410811:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2355:x1869199342331136:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1782607666.410903:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2355:x1869199342331136:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 96us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607666.410912:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 286 00000100:00100000:1.0:1782607666.412456:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607666.419187:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342331392 00000100:00100000:0.0:1782607666.419218:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342331392 00000100:00100000:0.0:1782607666.419387:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342331264 00000100:00100000:0.0:1782607666.419392:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342331264 00000100:00100000:2.0:1782607666.419451:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 134 00000100:00100000:2.0:1782607666.419467:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974578daa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2355:x1869199342331392:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607666.419575:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974578daa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2355:x1869199342331392:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 113us (9045us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607666.419583:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 134 00000100:00080000:1.0:1782607666.420471:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782607666.420756:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 135 00000100:00100000:0.0:1782607666.420791:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974578da9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2355:x1869199342331264:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1782607666.420884:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974578da9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2355:x1869199342331264:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 99us (8438us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607666.420892:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 135 00000100:00100000:1.0:1782607667.215236:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607667.216009:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342331520 00000100:00100000:2.0:1782607667.216026:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342331520 00000100:00100000:2.0:1782607667.216434:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 32 00000100:00100000:2.0:1782607667.216447:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974578daaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:10216:x1869199342331520:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782607667.216480:0:7437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607667.216515:0:7437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb3a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffcbe expref: -99 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607667.216623:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb3a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607667.216642:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb3a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607667.216657:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb3a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782607667.216967:0:7437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782607667.216972:0:7437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1782607667.217092:0:7437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb3a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607667.217127:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb3a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffcbe expref: 7 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607667.217162:0:7437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb3a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffcbe expref: 6 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607667.217172:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9745432c6600) 00010000:00010000:2.0:1782607667.217176:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782607667.217180:0:7437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585ada00, rc 0) 00000100:00100000:2.0:1782607667.217430:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974578daaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:10216:x1869199342331520:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 Request processed in 985us (2208us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607667.217448:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 32 00000100:00100000:1.0:1782607667.246515:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607667.252951:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342331648 00000100:00100000:2.0:1782607667.252973:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342331648 00000100:00100000:2.0:1782607667.253385:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 33 00000100:00100000:2.0:1782607667.253401:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974578dab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:10217:x1869199342331648:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782607667.253431:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607667.253460:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb3b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffcc5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607667.253556:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb3b7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607667.253574:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb3b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607667.253599:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb3b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607667.253619:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb3be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607667.253627:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb3be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607667.253635:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb3be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607667.254231:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad600/0x8109266df35cb3c5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607667.255845:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad600/0x8109266df35cb3c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607667.255861:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad600/0x8109266df35cb3c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782607667.256098:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1782607667.256103:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1782607667.256977:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad600/0x8109266df35cb3c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607667.257001:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb3b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607667.257008:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb3b7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607667.257015:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb3b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607667.257022:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ad000 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607667.257027:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb3b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607667.257035:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb3b7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607667.257053:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9745432c6600) 00010000:00010000:2.0:1782607667.257057:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607667.257061:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb3b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607667.257078:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb3b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607667.257095:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb3be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607667.257102:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb3be lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607667.257108:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb3be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607667.257113:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585acc00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607667.257116:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb3be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607667.257121:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb3be lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607667.257128:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9745432c6d00) 00010000:00010000:2.0:1782607667.258113:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607667.258121:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb3be lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607667.258468:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb3be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607667.258559:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb3b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffcc5 expref: 8 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607667.259022:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad600/0x8109266df35cb3c5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffcc5 expref: 7 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607667.259058:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9745432c6e00) 00010000:00010000:2.0:1782607667.259061:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782607667.259065:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585ad600, rc 0) 00000100:00100000:2.0:1782607667.260922:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974578dab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:10217:x1869199342331648:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 Request processed in 7509us (14404us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607667.260940:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 33 00000100:00100000:0.0:1782607667.265957:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782607667.265991:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457718ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364389888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782607667.266087:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607667.266222:0:6613:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364389888 00000100:00100000:0.0:1782607667.266232:0:6613:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364389888 00000100:00100000:0.0:1782607667.266317:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782607667.266330:0:6613:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457718c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364389888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782607667.266379:0:6613:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782607667.266428:0:6613:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457718c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364389888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607667.266435:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1782607667.266461:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1782607667.266494:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97457718ce00 x1869199364389888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607683 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782607667.266513:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457718ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364389888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782607667.270833:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607667.270927:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342331904 00000100:00100000:0.0:1782607667.270942:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342331904 00000100:00100000:0.0:1782607667.271021:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 34 00000100:00100000:0.0:1782607667.271035:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745776b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:10217:x1869199342331904:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782607667.271065:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607667.271092:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb3cc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffccc expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607667.271385:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb3d3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607667.271404:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb3d3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607667.271417:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb3d3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607667.271462:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43800/0x8109266df35cb3da lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607667.271471:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43800/0x8109266df35cb3da lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607667.271480:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43800/0x8109266df35cb3da lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607667.273031:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43a00/0x8109266df35cb3e1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607667.273054:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43a00/0x8109266df35cb3e1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607667.273064:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43a00/0x8109266df35cb3e1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782607667.273078:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1782607667.275758:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb3d3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607667.275953:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb3d3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607667.275963:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb3d3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607667.275970:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42c00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607667.275975:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb3d3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607667.276010:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb3d3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607667.276034:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9745432c6e00) 00010000:00010000:0.0:1782607667.276037:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782607667.276043:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb3d3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607667.276049:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb3d3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607667.276071:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43800/0x8109266df35cb3da lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607667.276076:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43800/0x8109266df35cb3da lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607667.276082:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43800/0x8109266df35cb3da lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607667.276088:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c43800 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607667.276090:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43800/0x8109266df35cb3da lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607667.276096:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43800/0x8109266df35cb3da lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607667.276104:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff97454c8e3500) 00010000:00010000:0.0:1782607667.276106:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782607667.276109:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43800/0x8109266df35cb3da lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607667.276125:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43800/0x8109266df35cb3da lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607667.277533:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb3cc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffccc expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607667.277558:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43a00/0x8109266df35cb3e1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffccc expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607667.277568:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97454c8e3f00) 00010000:00010000:0.0:1782607667.277571:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782607667.277575:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c43a00, rc 0) 00000100:00100000:0.0:1782607667.278917:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745776b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+9:10217:x1869199342331904:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 Request processed in 7880us (8098us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1782607667.278929:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 34 00000100:00100000:1.0:1782607667.283459:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607667.283748:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342332032 00000100:00100000:3.0:1782607667.283761:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342332032 00000100:00100000:3.0:1782607667.283868:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 35 00000100:00100000:3.0:1782607667.283881:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974578daa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+9:10217:x1869199342332032:12345-192.168.202.4@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1782607667.284062:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974578daa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+9:10217:x1869199342332032:12345-192.168.202.4@tcp:59:lhsmtool_posix.0 Request processed in 183us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607667.284071:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 35 00010000:00010000:0.0:1782607667.394209:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782607667.394614:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1782607668.294039:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457718ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364390016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782607668.294151:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607668.295405:0:6613:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364390016 00000100:00100000:3.0:1782607668.295422:0:6613:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364390016 00000100:00100000:3.0:1782607668.295525:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1782607668.295538:0:6613:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455d461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364390016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782607668.295598:0:6613:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1782607668.296978:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782607668.312556:0:6613:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455d461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364390016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 17003us (18388us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607668.312576:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1782607668.317381:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457718ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364390016:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782607668.435254:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782607668.930325:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:0.0:1782607669.446576:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607669.797348:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607669.797414:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342332160 00000100:00100000:3.0:1782607669.797424:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342332160 00000100:00100000:3.0:1782607669.797490:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 36 00000100:00100000:3.0:1782607669.797501:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974578da9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+8:10260:x1869199342332160:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1782607669.797521:0:7437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607669.797540:0:7437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649800/0x8109266df35cb3ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffcd3 expref: -99 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607669.797604:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cb3f6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607669.797617:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cb3f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607669.797628:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cb3f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1782607669.798158:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782607669.799619:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cb3fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607669.799640:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cb3fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607669.799651:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cb3fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607669.799913:0:7437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cb3f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607669.799921:0:7437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cb3f6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607669.799928:0:7437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cb3f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607669.799934:0:7437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d648c00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:3.0:1782607669.799939:0:7437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cb3f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607669.799948:0:7437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cb3f6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607669.799962:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9745432c6600) 00010000:00010000:3.0:1782607669.799966:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782607669.799971:0:7437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cb3f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607669.799978:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cb3f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607669.799994:0:7437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cb3fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607669.800000:0:7437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cb3fd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607669.800005:0:7437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cb3fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607669.800011:0:7437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d649c00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:3.0:1782607669.800014:0:7437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cb3fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607669.805671:0:7437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cb3fd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607669.805693:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9745454f5f00) 00010000:00010000:3.0:1782607669.805696:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782607669.805703:0:7437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cb3fd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607669.805709:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cb3fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607669.805778:0:7437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649800/0x8109266df35cb3ef lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffcd3 expref: 9 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607669.805788:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9745432c6600) 00010000:00010000:3.0:1782607669.805790:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782607669.805807:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649800/0x8109266df35cb3ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffcd3 expref: 9 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607669.805816:0:7437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97455d649800, rc 0) 00000100:00100000:3.0:1782607669.805885:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974578da9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+8:10260:x1869199342332160:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 8385us (8545us total) trans 0 rc 301/301 00000100:00100000:3.0:1782607669.805894:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 36 00000100:00100000:3.0:1782607669.829870:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745776b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fae11c6e-4506-4104-bb8c-df42498f7e08:3318:1869199364390144:0@lo:400:kworker.0 00000100:00100000:2.0:1782607669.829871:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607669.829900:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745776b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364390528:0@lo:400:kworker.0 00000100:00100000:3.0:1782607669.829918:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607669.829927:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607669.830523:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745776b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1869199364390656:0@lo:400:kworker.0 00000100:00100000:3.0:1782607669.830553:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607669.830584:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782607669.830590:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745776b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1869199364390272:0@lo:400:kworker.0 00000100:00100000:3.0:1782607669.830626:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607669.830646:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745776b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364390784:0@lo:400:kworker.0 00000100:00100000:2.0:1782607669.831170:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782607669.831186:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745776b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1869199364390400:0@lo:400:kworker.0 00000100:00100000:2.0:1782607669.831214:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607669.831245:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607669.831252:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342332416 00000100:00100000:2.0:1782607669.831259:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342332416 00000100:00100000:2.0:1782607669.831292:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364390656 00000100:00100000:2.0:1782607669.831295:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364390656 00000100:00100000:2.0:1782607669.831318:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364390272 00000100:00100000:2.0:1782607669.831321:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364390272 00000100:00100000:2.0:1782607669.831334:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364390400 00000100:00100000:2.0:1782607669.831337:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364390400 00000100:00100000:3.0:1782607669.831345:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364390144 00000100:00100000:3.0:1782607669.831349:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364390144 00000100:00100000:2.0:1782607669.831353:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1782607669.831367:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745776b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869199364390656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607669.831375:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1782607669.831381:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3318:x1869199364390144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607669.831429:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3318:x1869199364390144:12345-0@lo:400:kworker.0 Request processed in 48us (1509us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607669.831436:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1782607669.831468:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1782607669.831476:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f46fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1869199364390272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607669.831501:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f46fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1869199364390272:12345-0@lo:400:kworker.0 Request processed in 28us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607669.831515:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1782607669.831527:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1782607669.831532:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455d461880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869199364390400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607669.831557:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455d461880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869199364390400:12345-0@lo:400:kworker.0 Request processed in 25us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607669.831562:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1782607669.831572:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 37 00000100:00100000:3.0:1782607669.831578:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455d463800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+8:10260:x1869199342332416:12345-192.168.202.4@tcp:36:lfs.0 00010000:00010000:3.0:1782607669.831621:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782607669.831646:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb3a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffcbe expref: 8 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607669.832243:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9745432c6600) 00010000:00010000:3.0:1782607669.832261:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782607669.832575:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745776b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869199364390656:12345-0@lo:400:kworker.0 Request processed in 1207us (2019us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607669.832583:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00010000:00010000:3.0:1782607669.832585:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649800/0x8109266df35cb404 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607669.832598:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649800/0x8109266df35cb404 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607669.832607:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649800/0x8109266df35cb404 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607669.832610:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364390528 00000100:00100000:2.0:1782607669.832614:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364390528 00010000:00010000:3.0:1782607669.832619:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cb40b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607669.832626:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cb40b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607669.832641:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cb40b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607669.832652:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364390784 00000100:00100000:2.0:1782607669.832655:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364390784 00000100:00100000:2.0:1782607669.832678:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1782607669.832685:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455d461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364390528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607669.832715:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455d461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364390528:12345-0@lo:400:kworker.0 Request processed in 31us (2787us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607669.832721:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1782607669.832732:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1782607669.832737:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f46d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364390784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607669.832780:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f46d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364390784:12345-0@lo:400:kworker.0 Request processed in 26us (1517us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607669.832786:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1782607669.832805:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782607669.832809:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782607669.834500:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745776b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1869199364390400:0@lo:400:kworker.0 00000100:00100000:2.0:1782607669.834515:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745776b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364390528:0@lo:400:kworker.0 00000100:00100000:1.0:1782607669.835191:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745776b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1869199364390272:0@lo:400:kworker.0 00010000:00080000:1.0:1782607669.835209:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9745776b5500 x1869199364390784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782607685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607669.835220:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745776b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364390784:0@lo:400:kworker.0 00000100:00100000:1.0:1782607669.835232:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745776b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fae11c6e-4506-4104-bb8c-df42498f7e08:3318:1869199364390144:0@lo:400:kworker.0 00000100:00100000:1.0:1782607669.835244:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745776b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1869199364390656:0@lo:400:kworker.0 00000004:00200000:3.0:1782607669.836373:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1782607669.836392:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649800/0x8109266df35cb404 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607669.836402:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649800/0x8109266df35cb404 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607669.836410:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649800/0x8109266df35cb404 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607669.836416:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d649800 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:3.0:1782607669.836421:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649800/0x8109266df35cb404 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607669.836429:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649800/0x8109266df35cb404 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607669.836446:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9745454f5f00) 00010000:00010000:3.0:1782607669.836449:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782607669.836453:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649800/0x8109266df35cb404 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607669.836459:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649800/0x8109266df35cb404 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782607669.836478:0:5805:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007e6db4a1 reply state 00000000b13b3a7c transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cb40b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607669.836499:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782607669.836664:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455d463800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+9:10260:x1869199342332416:12345-192.168.202.4@tcp:36:lfs.0 Request processed in 5082us (6794us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1782607669.836672:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 37 00010000:00010000:2.0:1782607669.843139:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cb40b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607669.843153:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cb40b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607669.843192:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cb40b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607669.843198:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d649c00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607669.843203:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cb40b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607669.843211:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cb40b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607669.843228:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9745454f5c00) 00010000:00010000:2.0:1782607669.843231:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607669.843236:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cb40b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607669.843242:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cb40b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607669.969546:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607669.969729:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342332544 00000100:00100000:0.0:1782607669.969739:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342332544 00000100:00100000:0.0:1782607669.969835:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 38 00000100:00100000:0.0:1782607669.969847:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745776b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+8:10268:x1869199342332544:12345-192.168.202.4@tcp:101:lctl.0 00010000:00010000:1.0:1782607669.970166:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607669.970205:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467a00/0x8109266df35cb412 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffcda expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607669.970282:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466800/0x8109266df35cb419 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607669.970313:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466800/0x8109266df35cb419 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607669.970325:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466800/0x8109266df35cb419 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782607669.970647:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1782607669.970652:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1782607669.970696:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466800/0x8109266df35cb419 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607669.970724:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467a00/0x8109266df35cb412 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffcda expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607669.970743:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466800/0x8109266df35cb419 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffcda expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607669.970752:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff974543e77800) 00010000:00010000:1.0:1782607669.970755:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782607669.970759:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97457f466800, rc 0) 00000100:00100000:1.0:1782607669.970926:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745776b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+9:10268:x1869199342332544:12345-192.168.202.4@tcp:101:lctl.0 Request processed in 1080us (1388us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607669.970933:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 38 00000100:00100000:1.0:1782607670.046824:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607670.046929:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342332672 00000100:00100000:0.0:1782607670.046938:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342332672 00000100:00100000:0.0:1782607670.047003:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 39 00000100:00100000:0.0:1782607670.047014:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974578da9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+9:10274:x1869199342332672:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:0.0:1782607670.047060:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607670.047081:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42e00/0x8109266df35cb420 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffce1 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.047154:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cb427 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.047177:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cb427 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.047189:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cb427 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.047207:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb42e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.047215:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb42e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.047222:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb42e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.047328:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42800/0x8109266df35cb435 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.047336:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42800/0x8109266df35cb435 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.047344:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42800/0x8109266df35cb435 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782607670.047385:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1782607670.047393:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782607670.047437:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42800/0x8109266df35cb435 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.047450:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cb427 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.047456:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cb427 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.047463:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cb427 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.047469:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c43200 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607670.047472:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cb427 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.047479:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cb427 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.047491:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff974543e77800) 00010000:00010000:0.0:1782607670.047494:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782607670.047500:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cb427 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.047506:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cb427 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.047521:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb42e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.047526:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb42e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.047542:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb42e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.047547:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42000 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607670.047550:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb42e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.047938:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb42e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.047948:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff97454c8e3500) 00010000:00010000:0.0:1782607670.047951:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782607670.047954:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb42e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.047960:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb42e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.047997:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42e00/0x8109266df35cb420 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffce1 expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.048011:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42800/0x8109266df35cb435 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffce1 expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.048213:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97454c8e3300) 00010000:00010000:0.0:1782607670.048215:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782607670.048218:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c42800, rc 0) 00000100:00100000:0.0:1782607670.048287:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974578da9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+10:10274:x1869199342332672:12345-192.168.202.4@tcp:101:bash.0 Request processed in 1275us (1472us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607670.048305:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 39 00000100:00100000:3.0:1782607670.054343:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607670.057649:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342332928 00000100:00100000:2.0:1782607670.057671:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342332928 00000100:00100000:2.0:1782607670.057759:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 40 00000100:00100000:2.0:1782607670.057834:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f46ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+10:10274:x1869199342332928:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:2.0:1782607670.057867:0:7437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607670.057896:0:7437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb43c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffce8 expref: -99 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.058082:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb443 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.058131:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb443 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.058142:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb443 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.058216:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb44a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.058227:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb44a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.058233:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb44a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782607670.061902:0:7437:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1782607670.062360:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb451 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.062496:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb451 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.062510:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb451 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.062606:0:7437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb443 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.062615:0:7437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb443 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.062622:0:7437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb443 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.062639:0:7437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ac600 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607670.062643:0:7437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb443 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.062651:0:7437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb443 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.062663:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97454c8e3300) 00010000:00010000:2.0:1782607670.062666:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607670.062671:0:7437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb443 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.062678:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb443 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782607670.062693:0:7437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001c1b619d reply state 000000005b73682a transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb44a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607670.062702:0:7437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782607670.062741:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb43c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffce8 expref: 13 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.062756:0:7437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb451 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffce8 expref: 12 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.063984:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745432c6000) 00010000:00010000:2.0:1782607670.063991:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782607670.063995:0:7437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585ada00, rc 0) 00000100:00100000:2.0:1782607670.065410:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f46ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+13:10274:x1869199342332928:12345-192.168.202.4@tcp:101:bash.0 Request processed in 7571us (11068us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1782607670.065436:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 40 00010000:00010000:0.0:1782607670.075130:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb44a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.075148:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb44a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.075155:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb44a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.075161:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ad000 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607670.075166:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb44a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.075181:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb44a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.075197:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9745432c6900) 00010000:00010000:0.0:1782607670.075201:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782607670.075206:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb44a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.075212:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb44a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607670.078136:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607670.078259:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342333056 00000100:00100000:2.0:1782607670.078271:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342333056 00000100:00100000:2.0:1782607670.078324:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 20 00000100:00100000:2.0:1782607670.078333:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457718ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1869199342333056:12345-192.168.202.4@tcp:8:bash.0 00010000:00080000:2.0:1782607670.078366:0:6608:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from d72d7fb9-639f-4ad9-b658-df715cbf7792@192.168.202.4@tcp t0 exp 0000000000000000 cur 328 last 0 00000020:00000080:2.0:1782607670.078409:0:6608:0:(genops.c:1406:class_connect()) connect: client d72d7fb9-639f-4ad9-b658-df715cbf7792, cookie 0x8109266df35cb45f 00002000:00100000:2.0:1782607670.078422:0:6608:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d72d7fb9-639f-4ad9-b658-df715cbf7792/ffff97457772b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782607670.078446:0:6608:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1782607670.078700:0:6608:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1782607670.078733:0:6608:0:(import.c:65:import_set_state_nolock()) ffff97457772a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782607670.078843:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457718ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2353:x1869199342333056:12345-192.168.202.4@tcp:8:bash.0 Request processed in 508us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607670.078851:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 20 00000100:00100000:2.0:1782607670.084292:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607670.084445:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342333184 00000100:00100000:3.0:1782607670.084455:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342333184 00000100:00100000:3.0:1782607670.084515:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 21 00000100:00100000:3.0:1782607670.084525:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745776b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:0:x1869199342333184:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:3.0:1782607670.084542:0:6610:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1782607670.084709:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782607670.084743:0:6610:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099d9d6f6/0x8109266df35cb466 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffcef expref: -99 pid: 6610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782607670.084802:0:6610:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782607670.084822:0:6610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=328s v=(0 0) 00010000:00010000:3.0:1782607670.084826:0:6610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782607670.084837:0:6610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099d9d6f6/0x8109266df35cb466 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffcef expref: 7 pid: 6610 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607670.084856:0:6610:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000099d9d6f6/0x8109266df35cb466 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffcef expref: 7 pid: 6610 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607670.084869:0:6610:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97455d649800, rc 0) 00000100:00100000:3.0:1782607670.084917:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745776b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:0:x1869199342333184:12345-192.168.202.4@tcp:101:bash.0 Request processed in 395us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607670.084939:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 21 00000100:00100000:1.0:1782607670.093874:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607670.093973:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342333312 00000100:00100000:2.0:1782607670.093982:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342333312 00000100:00100000:2.0:1782607670.094028:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 22 00000100:00100000:2.0:1782607670.094039:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974578dabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:10274:x1869199342333312:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:2.0:1782607670.094056:0:6608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607670.094077:0:6608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dbf6da63/0x8109266df35cb46d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffcf6 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.094121:0:6608:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000099d9d6f6/0x8109266df35cb466 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffcef expref: 8 pid: 6610 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.094145:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782607670.094148:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782607670.094155:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dbf6da63/0x8109266df35cb46d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffcf6 expref: 8 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.094201:0:6608:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000099d9d6f6/0x8109266df35cb466 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffcef expref: 8 pid: 6610 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.094215:0:6608:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000099d9d6f6/0x8109266df35cb466 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffcef expref: 8 pid: 6610 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607670.094231:0:6608:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745776b5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6608:1869199364390912:192.168.202.4@tcp:104: 00000100:00100000:2.0:1782607670.094323:0:6608:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745810bf840 going to sleep for 11 seconds 00000100:00100000:2.0:1782607670.100124:0:6608:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745776b5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6608:1869199364390912:192.168.202.4@tcp:104: 00010000:00010000:2.0:1782607670.100184:0:6608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dbf6da63/0x8109266df35cb46d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffcf6 expref: 8 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.100208:0:6608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585acc00, rc 0) 00000100:00100000:2.0:1782607670.100270:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974578dabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+8:10274:x1869199342333312:12345-192.168.202.4@tcp:101:bash.0 Request processed in 6233us (6405us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607670.100279:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 22 00000100:00100000:3.0:1782607670.106879:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607670.106967:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342333440 00000100:00100000:0.0:1782607670.106977:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342333440 00010000:00010000:0.0:1782607670.107016:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000099d9d6f6/0x8109266df35cb466 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffcef expref: 8 pid: 6610 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607670.107079:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 35 00000100:00100000:0.0:1782607670.107097:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f46f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+8:2354:x1869199342333440:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782607670.107115:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782607670.107137:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000099d9d6f6/0x8109266df35cb466 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffcef expref: 8 pid: 6610 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.107151:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000099d9d6f6/0x8109266df35cb466 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffcef expref: 8 pid: 6610 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.107194:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099d9d6f6/0x8109266df35cb466 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffcef expref: 8 pid: 6610 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.107211:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607670.107216:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607670.107225:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dbf6da63/0x8109266df35cb46d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffcf6 expref: 7 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.107235:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dbf6da63/0x8109266df35cb46d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffcf6 expref: 7 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.107274:0:5787:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dbf6da63/0x8109266df35cb46d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffcf6 expref: 7 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607670.107289:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581008380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5787:1869199364391040:192.168.202.4@tcp:105: 00000100:00100000:0.0:1782607670.107642:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff97458124a540 going to sleep for 11 seconds 00000100:00100000:1.0:1782607670.119328:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607670.119510:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581008380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5787:1869199364391040:192.168.202.4@tcp:105: 00010000:00010000:0.0:1782607670.119534:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782607670.119604:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f46f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:2354:x1869199342333440:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 12516us (12733us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607670.119616:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 35 00000100:00100000:2.0:1782607670.120251:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342333696 00000100:00100000:2.0:1782607670.120260:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342333696 00000100:00100000:2.0:1782607670.120309:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 6 00000100:00100000:2.0:1782607670.120334:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974578da9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+12:10274:x1869199342333696:12345-192.168.202.4@tcp:35:bash.0 00000100:00100000:2.0:1782607670.122218:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974578da9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+13:10274:x1869199342333696:12345-192.168.202.4@tcp:35:bash.0 Request processed in 1876us (2892us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1782607670.122233:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 6 00000100:00100000:1.0:1782607670.279957:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607670.280120:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342333952 00000100:00100000:3.0:1782607670.280131:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342333952 00000100:00100000:3.0:1782607670.280273:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 41 00000100:00100000:3.0:1782607670.280284:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974578daad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+13:10284:x1869199342333952:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1782607670.280309:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607670.280329:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cb474 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffcfd expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782607670.280565:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1782607670.280759:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cb474 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffcfd expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607670.280806:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff974543e77800) 00010000:00010000:3.0:1782607670.280809:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782607670.280815:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cb474 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffcfd expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607670.280830:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97455d648c00, rc 0) 00000100:00100000:3.0:1782607670.280897:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974578daad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+14:10284:x1869199342333952:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 615us (952us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1782607670.280904:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 41 00000100:00100000:1.0:1782607670.286906:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607670.287005:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342334208 00000100:00100000:0.0:1782607670.287108:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342334208 00000100:00100000:0.0:1782607670.287215:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7 00000100:00100000:0.0:1782607670.287225:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974578dab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+14:10284:x1869199342334208:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:0.0:1782607670.287580:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974578dab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+15:10284:x1869199342334208:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 355us (682us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1782607670.287588:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7 00000100:00100000:2.0:1782607670.405154:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607670.408387:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342334336 00000100:00100000:1.0:1782607670.408402:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342334336 00000100:00100000:1.0:1782607670.408474:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 42 00000100:00100000:1.0:1782607670.408485:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745776b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+15:10290:x1869199342334336:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1782607670.408511:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607670.408532:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467000/0x8109266df35cb482 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffd04 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607670.408674:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb489 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607670.408689:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb489 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607670.408871:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb489 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782607670.408932:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1782607670.408936:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1782607670.408959:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb489 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607670.408983:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467000/0x8109266df35cb482 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd04 expref: 17 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607670.409001:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb489 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd04 expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607670.409009:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97454c8e3300) 00010000:00010000:1.0:1782607670.409012:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782607670.409259:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97457f467600, rc 0) 00000100:00100000:1.0:1782607670.409402:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745776b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+16:10290:x1869199342334336:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 917us (4254us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607670.409411:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 42 00000100:00100000:1.0:1782607670.413473:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607670.414919:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342334592 00000100:00100000:0.0:1782607670.414931:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342334592 00000100:00100000:0.0:1782607670.415002:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 43 00000100:00100000:0.0:1782607670.415014:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974578dab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+16:10290:x1869199342334592:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1782607670.415036:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607670.415297:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cb490 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffd0b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.415491:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42400/0x8109266df35cb497 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.415506:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42400/0x8109266df35cb497 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.415536:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42400/0x8109266df35cb497 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782607670.415550:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1782607670.415934:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cb490 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd0b expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.415959:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42400/0x8109266df35cb497 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd0b expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.415969:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745432c6000) 00010000:00010000:0.0:1782607670.415972:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782607670.415976:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c42400, rc 0) 00000100:00100000:0.0:1782607670.416151:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974578dab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+18:10290:x1869199342334592:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 1139us (2690us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1782607670.416174:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 43 00000100:00100000:0.0:1782607670.423583:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607670.423705:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607670.423898:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342334848 00000100:00100000:3.0:1782607670.423909:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342334848 00000100:00100000:3.0:1782607670.423993:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 44 00000100:00100000:3.0:1782607670.424003:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+18:10290:x1869199342334848:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1782607670.424039:0:7437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607670.424071:0:7437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cb4a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffd12 expref: -99 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607670.424183:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649000/0x8109266df35cb4ac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607670.424198:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649000/0x8109266df35cb4ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607670.424211:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649000/0x8109266df35cb4ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782607670.424224:0:7437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1782607670.424584:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cb4a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd12 expref: 21 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607670.424604:0:7437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649000/0x8109266df35cb4ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd12 expref: 20 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607670.424614:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745432c6000) 00010000:00010000:3.0:1782607670.424616:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1782607670.424619:0:7437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97455d649000, rc 0) 00000100:00100000:3.0:1782607670.424725:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+20:10290:x1869199342334848:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 723us (1019us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1782607670.424732:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 44 00000100:00100000:2.0:1782607670.425152:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342334976 00000100:00100000:2.0:1782607670.425222:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342334976 00000100:00100000:2.0:1782607670.425301:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2 00000100:00100000:2.0:1782607670.425310:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581008380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+20:2357:x1869199342334976:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782607670.425322:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782607670.425350:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42400/0x8109266df35cb497 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd0b expref: 20 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.425364:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745432c6000) 00010000:00010000:2.0:1782607670.425368:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782607670.425392:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581008380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+19:2357:x1869199342334976:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 84us (1820us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607670.425399:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2 00000100:00100000:2.0:1782607670.434877:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607670.435027:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342335104 00000100:00100000:1.0:1782607670.435038:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342335104 00000100:00100000:1.0:1782607670.435200:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 23 00000100:00100000:1.0:1782607670.435212:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745776b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:2355:x1869199342335104:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:1.0:1782607670.435262:0:6609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000088ef696/0x8109266df35cb4ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607670.435307:0:6609:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dbf6da63/0x8109266df35cb46d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffcf6 expref: 7 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607670.435317:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1782607670.435321:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782607670.435326:0:6609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000088ef696/0x8109266df35cb4ba lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607670.435369:0:6609:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dbf6da63/0x8109266df35cb46d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffcf6 expref: 7 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607670.435383:0:6609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dbf6da63/0x8109266df35cb46d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffcf6 expref: 7 pid: 6608 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607670.435398:0:6609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974578da8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6609:1869199364391168:192.168.202.4@tcp:104: 00000100:00100000:1.0:1782607670.435498:0:6609:0:(client.c:2701:ptlrpc_set_wait()) set ffff974550578300 going to sleep for 11 seconds 00000100:00100000:1.0:1782607670.440341:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607670.440494:0:6614:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342335232 00000100:00100000:2.0:1782607670.440504:0:6614:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342335232 00002000:00100000:2.0:1782607670.440554:0:6614:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff974578da8700 x1869199342335232/t0(0) o4->d72d7fb9-639f-4ad9-b658-df715cbf7792@192.168.202.4@tcp:586/0 lens 504/0 e 0 to 0 dl 1782607681 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782607670.440565:0:6614:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974578da8700 with x1869199342335232 ext(0->12) 00010000:00010000:2.0:1782607670.440574:0:6614:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dbf6da63/0x8109266df35cb46d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffcf6 expref: 8 pid: 6608 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.440609:0:6614:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dbf6da63/0x8109266df35cb46d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffcf6 expref: 8 pid: 6608 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782607670.440616:0:6614:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff974578da8700 00000100:00100000:2.0:1782607670.440664:0:6614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 0 00000100:00100000:2.0:1782607670.440674:0:6614:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974578da8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+8:2357:x1869199342335232:12345-192.168.202.4@tcp:4:lfs.0 00000100:00100000:3.0:1782607670.441349:0:6609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974578da8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6609:1869199364391168:192.168.202.4@tcp:104: 00010000:00010000:3.0:1782607670.441373:0:6609:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000088ef696/0x8109266df35cb4ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.474802:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1782607670.489983:0:7525:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d72d7fb9-639f-4ad9-b658-df715cbf7792 00000100:00100000:2.0:1782607670.549196:0:6614:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974578da8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+9:2357:x1869199342335232:12345-192.168.202.4@tcp:4:lfs.0 Request processed in 108512us (108853us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1782607670.549213:0:6614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 0 00002000:00100000:2.0:1782607670.549227:0:6614:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff974578da8700 x1869199342335232/t4294967299(0) o4->d72d7fb9-639f-4ad9-b658-df715cbf7792@192.168.202.4@tcp:586/0 lens 504/448 e 0 to 0 dl 1782607681 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782607670.549238:0:6614:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974578da8700 with x1869199342335232 ext(0->12) 00010000:00010000:2.0:1782607670.549249:0:6614:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dbf6da63/0x8109266df35cb46d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffcf6 expref: 9 pid: 6608 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.549268:0:6614:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dbf6da63/0x8109266df35cb46d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffcf6 expref: 9 pid: 6608 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782607670.549277:0:6614:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff974578da8700 00000001:00080000:3.0:1782607670.551315:0:7525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:2.0:1782607670.553955:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607670.554061:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342335360 00000100:00100000:0.0:1782607670.554071:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342335360 00010000:00010000:0.0:1782607670.554115:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dbf6da63/0x8109266df35cb46d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffcf6 expref: 7 pid: 6608 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607670.554176:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 36 00000100:00100000:0.0:1782607670.554186:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745776b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:2355:x1869199342335360:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782607670.554203:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1782607670.554234:0:5787:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1782607670.554238:0:5787:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1782607671 00002000:00010000:0.0:1782607670.554240:0:5787:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1782607671 00002000:00010000:0.0:1782607670.554242:0:5787:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1782607671 00002000:00010000:0.0:1782607670.554245:0:5787:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1782607670.554251:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dbf6da63/0x8109266df35cb46d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffcf6 expref: 7 pid: 6608 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.554266:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dbf6da63/0x8109266df35cb46d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffcf6 expref: 7 pid: 6608 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.554293:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dbf6da63/0x8109266df35cb46d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffcf6 expref: 7 pid: 6608 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.554315:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782607670.554319:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782607670.554326:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000088ef696/0x8109266df35cb4ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.554448:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000088ef696/0x8109266df35cb4ba lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.554485:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782607670.554552:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745776b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2355:x1869199342335360:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 367us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607670.554560:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 36 00010000:00010000:3.0:1782607670.554624:0:6609:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000088ef696/0x8109266df35cb4ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607670.554633:0:6609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000088ef696/0x8109266df35cb4ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607670.554658:0:6609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000088ef696/0x8109266df35cb4ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607670.554666:0:6609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000088ef696/0x8109266df35cb4ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607670.554686:0:6609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000088ef696/0x8109266df35cb4ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607670.554692:0:6609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f467e00 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:3.0:1782607670.554697:0:6609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000088ef696/0x8109266df35cb4ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607670.554705:0:6609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000088ef696/0x8109266df35cb4ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607670.554716:0:6609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000088ef696/0x8109266df35cb4ba lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607670.554736:0:6609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000088ef696/0x8109266df35cb4ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607670.554836:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745776b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2355:x1869199342335104:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 119627us (119971us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607670.554844:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 23 00000100:00100000:0.0:1782607670.559855:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607670.560018:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342335616 00000100:00100000:2.0:1782607670.560030:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342335616 00000100:00100000:2.0:1782607670.560110:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8 00000100:00100000:2.0:1782607670.560121:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+19:10290:x1869199342335616:12345-192.168.202.4@tcp:35:lfs.0 00000004:00010000:2.0:1782607670.560210:0:5806:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649000/0x8109266df35cb4ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd12 expref: 19 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782607670.561000:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1782607670.561087:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1782607670.563019:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1782607670.563119:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb4c1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.563139:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb451 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffce8 expref: 23 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.563148:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb4c1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.563492:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb451 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffce8 expref: 23 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.563509:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb451 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffce8 expref: 23 pid: 7437 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607670.563526:0:5806:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745776b7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5806:1869199364391296:192.168.202.4@tcp:104: 00000100:00100000:2.0:1782607670.563920:0:5806:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745810bf000 going to sleep for 11 seconds 00000100:00100000:1.0:1782607670.568811:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607670.569752:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342335744 00000100:00100000:0.0:1782607670.569790:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342335744 00010000:00010000:0.0:1782607670.569836:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb451 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffce8 expref: 24 pid: 7437 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607670.569919:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 37 00000100:00100000:0.0:1782607670.569928:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974578da8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+24:2356:x1869199342335744:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782607670.569943:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782607670.569949:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb451 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffce8 expref: 24 pid: 7437 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.569962:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb451 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffce8 expref: 24 pid: 7437 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.569982:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745432c6000) 00010000:00010000:0.0:1782607670.569987:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb4c1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.569996:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb4c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.570003:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb4c1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.570022:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782607670.570083:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974578da8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+24:2356:x1869199342335744:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 156us (1284us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607670.570091:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 37 00010000:00010000:2.0:1782607670.571636:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb451 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffce8 expref: 23 pid: 7437 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607670.571682:0:5806:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745776b7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5806:1869199364391296:192.168.202.4@tcp:104: 00010000:00010000:2.0:1782607670.571724:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb4c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.571735:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb4c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.571741:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb4c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782607670.571948:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1782607670.572181:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1782607670.572295:0:5806:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745776b7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5806:1869199364391424:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1782607670.572419:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607670.572454:0:5806:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745810bf9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782607670.572493:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364391424 00000100:00100000:2.0:1782607670.572499:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364391424 00000100:00100000:2.0:1782607670.572536:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782607670.572545:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974548949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5806:x1869199364391424:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1782607670.572614:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974548949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5806:x1869199364391424:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 69us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607670.572620:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782607670.572653:0:5806:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745776b7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5806:1869199364391424:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1782607670.573277:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1782607670.573331:0:5806:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974548948000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5806:1869199364391552:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1782607670.573361:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607670.573387:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364391552 00000100:00100000:2.0:1782607670.573391:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364391552 00000100:00100000:2.0:1782607670.573420:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782607670.573434:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97454894aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5806:x1869199364391552:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1782607670.573604:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97454894aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5806:x1869199364391552:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 170us (243us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1782607670.573611:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782607670.573630:0:5806:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745810bf000 going to sleep for 11 seconds 00000100:00100000:2.0:1782607670.573649:0:5806:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974548948000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5806:1869199364391552:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1782607670.573684:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1782607670.573714:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb4c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.573723:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb4c1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.573729:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb4c1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.573735:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ac600 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607670.573739:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb4c1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.573746:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb4c1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.573762:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745432c6000) 00010000:00010000:2.0:1782607670.573787:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1782607670.573793:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb4c1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.573799:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb4c1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782607670.573969:0:5806:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1782607670.574164:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1782607670.574188:0:5806:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 329420422329ns, next at 330420420128ns, rc = 0 00000001:00080000:2.0:1782607670.574197:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1782607670.574225:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745432c6000) 00010000:00010000:2.0:1782607670.574228:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1782607670.574234:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649000/0x8109266df35cb4ac lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd12 expref: 27 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607670.574345:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+26:10290:x1869199342335616:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 14226us (14501us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1782607670.574353:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8 00000020:00080000:2.0:1782607670.574357:0:5806:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1782607670.578253:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607670.578431:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342335872 00000100:00100000:3.0:1782607670.578443:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342335872 00000100:00100000:3.0:1782607670.578506:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 45 00000100:00100000:3.0:1782607670.578516:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974578da8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+26:10290:x1869199342335872:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1782607670.578542:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607670.578571:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cb4c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffd19 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607670.578631:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cb4c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd19 expref: 27 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607670.578656:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cb4c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd19 expref: 27 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607670.578863:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745454f5f00) 00010000:00010000:3.0:1782607670.578867:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782607670.578870:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97455d648c00, rc 0) 00000100:00100000:3.0:1782607670.578932:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974578da8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+27:10290:x1869199342335872:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 416us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607670.578958:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 45 00000100:00100000:0.0:1782607670.584245:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607670.584496:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342336128 00000100:00100000:3.0:1782607670.584506:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342336128 00000100:00100000:3.0:1782607670.584565:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 9 00000100:00100000:3.0:1782607670.584575:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549b89c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+27:10290:x1869199342336128:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:3.0:1782607670.584831:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549b89c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+28:10290:x1869199342336128:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 258us (595us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1782607670.584839:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 9 00000100:00100000:1.0:1782607670.697683:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607670.697804:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342336384 00000100:00100000:2.0:1782607670.697813:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342336384 00000100:00100000:2.0:1782607670.697862:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 46 00000100:00100000:2.0:1782607670.697870:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974578da8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+28:10300:x1869199342336384:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1782607670.697892:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607670.697909:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb4cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffd20 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782607670.698005:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1782607670.698094:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb4cf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd20 expref: 30 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.698104:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff974543e77800) 00010000:00010000:2.0:1782607670.698116:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782607670.698121:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb4cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd20 expref: 30 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.698131:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585ac600, rc 0) 00000100:00100000:2.0:1782607670.698190:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974578da8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+29:10300:x1869199342336384:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 320us (516us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1782607670.698197:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 46 00000100:00100000:1.0:1782607670.700856:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607670.700987:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342336512 00000100:00100000:0.0:1782607670.700995:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342336512 00000100:00100000:0.0:1782607670.701079:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 47 00000100:00100000:0.0:1782607670.701089:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974578da9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+29:10300:x1869199342336512:12345-192.168.202.4@tcp:34:lfs.0 00010000:00010000:0.0:1782607670.701149:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cb4dd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.701162:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cb4dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.701184:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cb4dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.701199:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb4e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.701206:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb4e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.701213:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb4e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.701292:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43800/0x8109266df35cb4eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.701297:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43800/0x8109266df35cb4eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.701302:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43800/0x8109266df35cb4eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782607670.701348:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43800/0x8109266df35cb4eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.701384:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cb4dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.701392:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cb4dd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.701399:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cb4dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.701404:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42a00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607670.701408:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cb4dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.701415:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cb4dd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.701427:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97454c8e3300) 00010000:00010000:0.0:1782607670.701429:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782607670.701433:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cb4dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.701440:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cb4dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.701453:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb4e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.701458:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb4e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.701463:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb4e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.701474:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42c00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607670.701477:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb4e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.701483:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb4e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.701491:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97454c8e3600) 00010000:00010000:0.0:1782607670.701494:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782607670.701496:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb4e4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.701502:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb4e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.701519:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43800/0x8109266df35cb4eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.701525:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43800/0x8109266df35cb4eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.701531:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43800/0x8109266df35cb4eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.701535:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c43800 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607670.701538:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43800/0x8109266df35cb4eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.701543:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43800/0x8109266df35cb4eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.701559:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745454f5f00) 00010000:00010000:0.0:1782607670.701561:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782607670.701564:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43800/0x8109266df35cb4eb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607670.701569:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43800/0x8109266df35cb4eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607670.701639:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974578da9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+29:10300:x1869199342336512:12345-192.168.202.4@tcp:34:lfs.0 Request processed in 550us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607670.701648:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 47 00000100:00100000:0.0:1782607670.704128:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607670.704252:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342336768 00000100:00100000:3.0:1782607670.704260:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342336768 00000100:00100000:3.0:1782607670.704324:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 10 00000100:00100000:3.0:1782607670.704341:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+29:10300:x1869199342336768:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:3.0:1782607670.704587:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+30:10300:x1869199342336768:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 254us (465us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1782607670.704596:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 10 00000100:00100000:1.0:1782607670.733801:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607670.733973:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342337024 00000100:00100000:2.0:1782607670.733984:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342337024 00000100:00100000:2.0:1782607670.734148:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 48 00000100:00100000:2.0:1782607670.734178:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974578dab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+30:10303:x1869199342337024:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1782607670.734204:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607670.734226:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb4f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffd27 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.734302:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb4f9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.734317:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb4f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.734328:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb4f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.734356:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb500 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.734364:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb500 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.734389:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb500 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.734524:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb507 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.734532:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb507 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.734541:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb507 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782607670.734550:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1782607670.734662:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb4f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.734670:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb4f9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.734677:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb4f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.734683:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ada00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607670.734687:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb4f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.734696:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb4f9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.734709:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97454c8e3300) 00010000:00010000:2.0:1782607670.734712:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607670.734722:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb4f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.734728:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb4f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.734743:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb500 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.734749:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb500 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.734755:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb500 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.734760:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ad000 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607670.734963:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb500 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.734973:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb500 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.734982:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9745432c6000) 00010000:00010000:2.0:1782607670.734984:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607670.734988:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb500 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.734994:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb500 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.735043:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb4f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd27 expref: 33 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.735078:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb507 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd27 expref: 32 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607670.735086:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745454f5f00) 00010000:00010000:2.0:1782607670.735088:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782607670.735091:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585acc00, rc 0) 00000100:00100000:2.0:1782607670.735152:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974578dab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+32:10303:x1869199342337024:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 995us (1395us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1782607670.735159:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 48 00000100:00100000:1.0:1782607670.739330:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607670.739405:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342337152 00000100:00100000:3.0:1782607670.739414:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342337152 00000100:00100000:3.0:1782607670.739508:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 49 00000100:00100000:3.0:1782607670.739518:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974578da8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+32:10303:x1869199342337152:12345-192.168.202.4@tcp:54:lfs.0 00010000:00010000:3.0:1782607670.739580:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cb515 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607670.739595:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cb515 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607670.739607:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cb515 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607670.739657:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cb515 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607670.739665:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cb515 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607670.739673:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cb515 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607670.739679:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d649600 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:3.0:1782607670.739683:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cb515 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607670.739690:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cb515 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607670.739702:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745454f5f00) 00010000:00010000:3.0:1782607670.739705:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782607670.739708:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cb515 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607670.739715:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cb515 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607670.739814:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974578da8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+32:10303:x1869199342337152:12345-192.168.202.4@tcp:54:lfs.0 Request processed in 296us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607670.739822:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 49 00000100:00100000:0.0:1782607670.742121:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607670.742278:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342337408 00000100:00100000:2.0:1782607670.742287:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342337408 00000100:00100000:2.0:1782607670.742366:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11 00000100:00100000:2.0:1782607670.742376:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+32:10303:x1869199342337408:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:2.0:1782607670.742659:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+33:10303:x1869199342337408:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 283us (545us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1782607670.742667:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11 00000100:00100000:1.0:1782607671.106801:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607671.106890:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342337664 00000100:00100000:3.0:1782607671.106901:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342337664 00000100:00100000:3.0:1782607671.106992:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 50 00000100:00100000:3.0:1782607671.107014:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974567326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+33:10334:x1869199342337664:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1782607671.107036:0:7437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607671.107054:0:7437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cb51c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffd2e expref: -99 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607671.107140:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cb523 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607671.107151:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cb523 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607671.107171:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cb523 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782607671.107184:0:7437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1782607671.107331:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cb51c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd2e expref: 36 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607671.107345:0:7437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cb523 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd2e expref: 35 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607671.107351:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745454f5f00) 00010000:00010000:3.0:1782607671.107354:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782607671.107356:0:7437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97455d649e00, rc 0) 00000100:00100000:3.0:1782607671.107408:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974567326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+35:10334:x1869199342337664:12345-192.168.202.4@tcp:101:cat.0 Request processed in 396us (620us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1782607671.107419:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 50 00000100:00080000:2.0:1782607671.113277:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782607671.115796:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607671.115913:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342337792 00000100:00100000:0.0:1782607671.115922:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342337792 00000100:00100000:0.0:1782607671.115990:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 3 00000100:00100000:0.0:1782607671.116001:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974548805c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+35:2354:x1869199342337792:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782607671.116019:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782607671.116045:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cb523 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd2e expref: 35 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607671.116075:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745454f5f00) 00010000:00010000:0.0:1782607671.116080:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782607671.116143:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974548805c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+34:2354:x1869199342337792:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 143us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607671.116151:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 3 00000100:00100000:0.0:1782607671.120324:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607671.120385:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342338048 00000100:00100000:3.0:1782607671.120396:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342338048 00000100:00100000:3.0:1782607671.120513:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 12 00000100:00100000:3.0:1782607671.120525:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+34:10334:x1869199342338048:12345-192.168.202.4@tcp:35:cat.0 00000100:00100000:3.0:1782607671.120828:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+35:10334:x1869199342338048:12345-192.168.202.4@tcp:35:cat.0 Request processed in 306us (511us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1782607671.120837:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 12 00000100:00100000:1.0:1782607671.180948:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607671.181227:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342338304 00000100:00100000:0.0:1782607671.181237:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342338304 00000100:00100000:0.0:1782607671.181346:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 51 00000100:00100000:0.0:1782607671.181358:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f386680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+35:10340:x1869199342338304:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:0.0:1782607671.181393:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607671.181396:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1782607671.181422:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb489 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd04 expref: 35 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607671.181440:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97454c8e3300) 00010000:00010000:0.0:1782607671.181444:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782607671.181456:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cb531 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffd35 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607671.182877:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb538 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607671.182899:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb507 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd27 expref: 35 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607671.182907:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb538 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607671.182958:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb507 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd27 expref: 35 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607671.182972:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb507 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd27 expref: 35 pid: 5804 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607671.183006:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97454773aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5803:1869199364391680:192.168.202.4@tcp:104: 00000100:00100000:0.0:1782607671.183116:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff97457f923780 going to sleep for 11 seconds 00000100:00100000:2.0:1782607671.189226:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97454773aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5803:1869199364391680:192.168.202.4@tcp:104: 00010000:00010000:2.0:1782607671.189257:0:5803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb538 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607671.191927:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607671.192218:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342338432 00000100:00100000:0.0:1782607671.192225:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342338432 00010000:00010000:0.0:1782607671.192260:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb507 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd27 expref: 36 pid: 5804 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607671.192304:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 38 00000100:00100000:0.0:1782607671.192314:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f385880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+36:2357:x1869199342338432:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782607671.192330:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782607671.192347:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb507 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd27 expref: 36 pid: 5804 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607671.192361:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb507 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd27 expref: 36 pid: 5804 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607671.192394:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb507 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd27 expref: 36 pid: 5804 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607671.192411:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745454f5f00) 00010000:00010000:0.0:1782607671.192416:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb538 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607671.192425:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb538 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607671.192451:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb538 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607671.192479:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782607671.192507:0:5803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb538 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607671.192515:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb538 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607671.192540:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f385880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+35:2357:x1869199342338432:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 228us (623us total) trans 0 rc 0/0 00000004:00200000:2.0:1782607671.192544:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00000100:00100000:0.0:1782607671.192547:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 38 00010000:00010000:2.0:1782607671.192702:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cb531 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd35 expref: 36 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607671.192718:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb538 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd35 expref: 35 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607671.192725:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745454f5f00) 00010000:00010000:2.0:1782607671.192728:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782607671.192730:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c43400, rc 0) 00000100:00100000:2.0:1782607671.192756:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f386680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+35:10340:x1869199342338304:12345-192.168.202.4@tcp:101:dd.0 Request processed in 11401us (11882us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1782607671.192804:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 51 00000100:00100000:1.0:1782607671.197554:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607671.197674:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342338688 00000100:00100000:3.0:1782607671.197684:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342338688 00000100:00100000:3.0:1782607671.197740:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 52 00000100:00100000:3.0:1782607671.197750:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f386a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+35:10340:x1869199342338688:12345-192.168.202.4@tcp:36:dd.0 00010000:00010000:3.0:1782607671.198340:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cb546 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607671.198358:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cb546 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607671.198371:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cb546 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782607671.198699:0:7437:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1782607671.198722:0:7437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000663249f9 reply state 000000005cf62ed9 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cb546 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607671.198731:0:7437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782607671.198839:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f386a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+38:10340:x1869199342338688:12345-192.168.202.4@tcp:36:dd.0 Request processed in 1088us (1294us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1782607671.198848:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 52 00000020:00080000:3.0:1782607671.198853:0:7437:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1782607671.201313:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cb546 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607671.201328:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cb546 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607671.201337:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cb546 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607671.201342:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d649600 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607671.201347:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cb546 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607671.201354:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cb546 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607671.201397:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745454f5f00) 00010000:00010000:2.0:1782607671.201400:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607671.201405:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cb546 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607671.201411:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cb546 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607671.494585:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607671.520115:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607671.520242:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342338816 00000100:00100000:3.0:1782607671.520252:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342338816 00000100:00100000:3.0:1782607671.520340:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 53 00000100:00100000:3.0:1782607671.520351:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f387100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+37:10353:x1869199342338816:12345-192.168.202.4@tcp:101:stat.0 00010000:00010000:3.0:1782607671.520376:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607671.520396:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cb54d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffd3c expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607671.520463:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cb554 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607671.520476:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cb554 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607671.520488:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cb554 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607671.520500:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cb55b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607671.520507:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cb55b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607671.520512:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cb55b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607671.520619:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649000/0x8109266df35cb562 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607671.520630:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb538 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd35 expref: 38 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607671.520638:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649000/0x8109266df35cb562 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607671.520676:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb538 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd35 expref: 38 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607671.520689:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb538 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd35 expref: 38 pid: 5803 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607671.520702:0:5805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f46f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1869199364391808:192.168.202.4@tcp:104: 00000100:00100000:3.0:1782607671.520848:0:5805:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745486eb240 going to sleep for 11 seconds 00000100:00100000:1.0:1782607671.523349:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607671.523491:0:5805:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f46f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1869199364391808:192.168.202.4@tcp:104: 00010000:00010000:0.0:1782607671.523519:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649000/0x8109266df35cb562 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607671.523620:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342339072 00000100:00100000:2.0:1782607671.523627:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342339072 00000100:00100000:2.0:1782607671.523678:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 13 00000100:00100000:2.0:1782607671.523687:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f386300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+39:5568:x1869199342339072:12345-192.168.202.4@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1782607671.524112:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f386300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+40:5568:x1869199342339072:12345-192.168.202.4@tcp:35:ldlm_bl.0 Request processed in 424us (770us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1782607671.524121:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 13 00000100:00100000:3.0:1782607671.529297:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607671.529460:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342339200 00000100:00100000:0.0:1782607671.529470:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342339200 00010000:00010000:0.0:1782607671.529516:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb538 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd35 expref: 40 pid: 5803 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607671.529563:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 39 00000100:00100000:0.0:1782607671.529574:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f46ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+40:2357:x1869199342339200:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782607671.529591:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782607671.529599:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb538 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd35 expref: 40 pid: 5803 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607671.529611:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb538 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd35 expref: 40 pid: 5803 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607671.529635:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb538 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd35 expref: 40 pid: 5803 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607671.529672:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745454f5f00) 00010000:00010000:0.0:1782607671.529678:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649000/0x8109266df35cb562 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607671.529686:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649000/0x8109266df35cb562 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607671.529694:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649000/0x8109266df35cb562 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607671.529733:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782607671.529818:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f46ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+39:2357:x1869199342339200:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 244us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607671.529826:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 39 00000100:00100000:3.0:1782607671.530293:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607671.530497:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342339328 00000100:00100000:2.0:1782607671.530502:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342339328 00000100:00100000:2.0:1782607671.530532:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 288 00000100:00100000:2.0:1782607671.530540:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2356:x1869199342339328:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607671.530591:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2356:x1869199342339328:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 52us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607671.530599:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 288 00010000:00010000:1.0:1782607671.530980:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649000/0x8109266df35cb562 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.530987:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649000/0x8109266df35cb562 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782607671.531026:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1782607671.531029:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782607671.531063:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649000/0x8109266df35cb562 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.531077:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649000/0x8109266df35cb562 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.531087:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cb554 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.531100:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cb554 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.531104:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cb554 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.531108:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d649600 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607671.531111:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cb554 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.531116:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cb554 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.531124:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97454c8e3300) 00010000:00010000:1.0:1782607671.531126:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607671.531129:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cb554 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.531132:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cb554 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.531140:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cb55b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.531144:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cb55b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.531148:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cb55b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.531151:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d649e00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607671.531170:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cb55b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.531176:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cb55b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.531184:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9745454f5900) 00010000:00010000:1.0:1782607671.531186:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607671.531190:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cb55b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.531195:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cb55b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.531232:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cb54d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd3c expref: 39 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.531242:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649000/0x8109266df35cb562 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd3c expref: 38 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.531247:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745454f5f00) 00010000:00010000:1.0:1782607671.531248:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782607671.531250:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97455d649000, rc 0) 00000100:00100000:1.0:1782607671.531280:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f387100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+38:10353:x1869199342338816:12345-192.168.202.4@tcp:101:stat.0 Request processed in 10932us (11174us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607671.531287:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 53 00000100:00100000:0.0:1782607671.540301:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607671.540416:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607671.540560:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342339584 00000100:00100000:1.0:1782607671.540570:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342339584 00000100:00100000:1.0:1782607671.540658:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 139 00000100:00100000:1.0:1782607671.540669:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97454773aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2357:x1869199342339584:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1782607671.540793:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97454773aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2357:x1869199342339584:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 126us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607671.540802:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 139 00000100:00080000:0.0:1782607671.542340:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782607671.542477:0:9088:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342339456 00000100:00100000:2.0:1782607671.542486:0:9088:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342339456 00000100:00100000:2.0:1782607671.542652:0:9088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 78 00000100:00100000:2.0:1782607671.542663:0:9088:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974547739880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2357:x1869199342339456:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607671.542749:0:9088:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974547739880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2357:x1869199342339456:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 88us (2459us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607671.542757:0:9088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 78 00000100:00100000:0.0:1782607671.639754:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607671.639982:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342339840 00000100:00100000:2.0:1782607671.639996:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342339840 00000100:00100000:2.0:1782607671.640097:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 54 00000100:00100000:2.0:1782607671.640113:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+38:10360:x1869199342339840:12345-192.168.202.4@tcp:36:truncate.0 00010000:00010000:2.0:1782607671.640226:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782607671.640742:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649000/0x8109266df35cb562 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd3c expref: 38 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607671.640814:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745454f5f00) 00010000:00010000:2.0:1782607671.640821:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782607671.641377:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb569 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607671.641843:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb569 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607671.641860:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb569 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782607671.641946:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1782607671.641982:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f80b2d20 reply state 0000000083b5eb19 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb569 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607671.641992:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782607671.642526:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+40:10360:x1869199342339840:12345-192.168.202.4@tcp:36:truncate.0 Request processed in 2411us (2785us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1782607671.642559:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 54 00000020:00080000:2.0:1782607671.642568:0:5803:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782607671.657497:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb569 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607671.657523:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb569 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607671.657533:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb569 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607671.657540:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ad000 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:3.0:1782607671.657548:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb569 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607671.657558:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb569 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607671.657583:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745454f5f00) 00010000:00010000:3.0:1782607671.657587:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782607671.657591:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb569 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607671.657619:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb569 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607671.831484:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607671.832258:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342339968 00000100:00100000:1.0:1782607671.832273:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342339968 00000100:00100000:1.0:1782607671.832351:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 55 00000100:00100000:1.0:1782607671.832364:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974578da8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+39:10374:x1869199342339968:12345-192.168.202.4@tcp:101:stat.0 00010000:00010000:1.0:1782607671.832407:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607671.832437:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cb570 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffd43 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.832527:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cb577 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.832545:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cb577 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.832558:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cb577 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.832575:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467000/0x8109266df35cb57e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.832582:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467000/0x8109266df35cb57e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.832589:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467000/0x8109266df35cb57e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.832735:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb585 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.832799:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb585 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.832808:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb585 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782607671.832858:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1782607671.832864:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782607671.832890:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb585 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.832904:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb585 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.832914:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cb577 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.832921:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cb577 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.832929:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cb577 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.832937:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f466c00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607671.832942:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cb577 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.832951:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cb577 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.832967:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97454c8e3300) 00010000:00010000:1.0:1782607671.832976:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607671.832983:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cb577 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.832990:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cb577 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.833008:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467000/0x8109266df35cb57e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.833015:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467000/0x8109266df35cb57e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.833021:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467000/0x8109266df35cb57e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.833026:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f467000 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607671.833029:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467000/0x8109266df35cb57e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.833035:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467000/0x8109266df35cb57e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.833041:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff974543e77200) 00010000:00010000:1.0:1782607671.833043:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607671.833058:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467000/0x8109266df35cb57e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.833064:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467000/0x8109266df35cb57e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.833097:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cb570 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd43 expref: 41 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.833122:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb585 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd43 expref: 40 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607671.833130:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745454f5f00) 00010000:00010000:1.0:1782607671.833132:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782607671.833135:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97457f466400, rc 0) 00000100:00100000:1.0:1782607671.833235:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974578da8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+40:10374:x1869199342339968:12345-192.168.202.4@tcp:101:stat.0 Request processed in 873us (1767us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607671.833244:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 55 00000100:00100000:1.0:1782607671.917465:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607671.917667:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342340224 00000100:00100000:0.0:1782607671.917681:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342340224 00000100:00100000:0.0:1782607671.917761:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 56 00000100:00100000:0.0:1782607671.917805:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f385c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+40:10384:x1869199342340224:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1782607671.917833:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607671.917859:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cb58c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffd4a expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782607671.918302:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1782607671.918500:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cb58c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd4a expref: 42 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607671.918519:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff974543e77800) 00010000:00010000:0.0:1782607671.918522:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782607671.918528:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cb58c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd4a expref: 42 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607671.918546:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c42a00, rc 0) 00000100:00100000:0.0:1782607671.918817:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f385c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+41:10384:x1869199342340224:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 963us (1318us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1782607671.918827:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 56 00000100:00100000:0.0:1782607671.922509:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607671.922599:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342340480 00000100:00100000:3.0:1782607671.922618:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342340480 00000100:00100000:3.0:1782607671.926360:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 14 00000100:00100000:3.0:1782607671.926392:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974551140a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+41:10384:x1869199342340480:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:3.0:1782607671.926801:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974551140a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+42:10384:x1869199342340480:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 426us (4305us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1782607671.926814:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 14 00000100:00100000:1.0:1782607671.985139:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607671.986470:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342340736 00000100:00100000:2.0:1782607671.986488:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342340736 00000100:00100000:2.0:1782607671.986580:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 57 00000100:00100000:2.0:1782607671.986593:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f385f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+42:10390:x1869199342340736:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:2.0:1782607671.986641:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607671.986672:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb59a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffd51 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607671.986866:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb5a1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607671.986885:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb585 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd43 expref: 43 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607671.986896:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb5a1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607671.986944:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb585 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd43 expref: 43 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607671.986960:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb585 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd43 expref: 43 pid: 5804 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607671.986975:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97454894bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5804:1869199364391936:192.168.202.4@tcp:104: 00000100:00100000:2.0:1782607671.987113:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745810bfa80 going to sleep for 11 seconds 00000100:00100000:1.0:1782607671.991007:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607671.991102:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97454894bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5804:1869199364391936:192.168.202.4@tcp:104: 00010000:00010000:2.0:1782607671.991145:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb5a1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607671.991266:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342340864 00000100:00100000:0.0:1782607671.991277:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342340864 00010000:00010000:0.0:1782607671.991318:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb585 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd43 expref: 44 pid: 5804 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607671.991362:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 40 00000100:00100000:0.0:1782607671.991372:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f387b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+44:2356:x1869199342340864:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782607671.991388:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782607671.991395:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb585 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd43 expref: 44 pid: 5804 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607671.991408:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb585 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd43 expref: 44 pid: 5804 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607671.991431:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb585 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd43 expref: 44 pid: 5804 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607671.991463:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745454f5f00) 00010000:00010000:0.0:1782607671.991469:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb5a1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607671.991478:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb5a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607671.991486:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb5a1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607671.991516:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782607671.991563:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb5a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607671.991574:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb5a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782607671.991601:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1782607671.992117:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb59a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd51 expref: 45 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607671.992146:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb5a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd51 expref: 44 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607671.992169:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745454f5f00) 00010000:00010000:2.0:1782607671.992178:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00000100:00100000:0.0:1782607671.992178:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f387b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+44:2356:x1869199342340864:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 799us (1173us total) trans 0 rc 0/0 00010000:00010000:2.0:1782607671.992186:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585ace00, rc 0) 00000100:00100000:0.0:1782607671.992198:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 40 00000100:00100000:2.0:1782607671.992251:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f385f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+43:10390:x1869199342340736:12345-192.168.202.4@tcp:101:bash.0 Request processed in 5659us (7127us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1782607671.992261:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 57 00000100:00100000:0.0:1782607671.996387:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607671.996465:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342341120 00000100:00100000:2.0:1782607671.996483:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342341120 00000100:00100000:2.0:1782607671.996568:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 58 00000100:00100000:2.0:1782607671.996580:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580e53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+43:10390:x1869199342341120:12345-192.168.202.4@tcp:36:bash.0 00010000:00010000:2.0:1782607671.997326:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb5af lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607671.997368:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb5af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607671.997381:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb5af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782607671.997454:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1782607671.997480:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007e08c1b0 reply state 00000000e6b9f2c7 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb5af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607671.997491:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782607671.999066:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580e53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+46:10390:x1869199342341120:12345-192.168.202.4@tcp:36:bash.0 Request processed in 2476us (2677us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1782607671.999078:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 58 00000020:00080000:2.0:1782607671.999087:0:5803:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1782607672.003858:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb5af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.003881:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb5af lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.003889:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb5af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.003896:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ad000 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607672.003902:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb5af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.003910:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb5af lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.003954:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745454f5f00) 00010000:00010000:2.0:1782607672.003957:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607672.003962:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb5af lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.003969:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb5af lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607672.014547:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607672.015404:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342341248 00000100:00100000:3.0:1782607672.015421:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342341248 00000100:00100000:3.0:1782607672.015535:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 59 00000100:00100000:3.0:1782607672.015550:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580e52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+45:10390:x1869199342341248:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:3.0:1782607672.015587:0:7437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607672.015618:0:7437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cb5b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffd58 expref: -99 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607672.016105:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cb5bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607672.016125:0:7437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb5a1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd51 expref: 46 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607672.016135:0:7437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cb5bd lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607672.016204:0:7437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb5a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd51 expref: 46 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607672.016221:0:7437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb5a1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd51 expref: 46 pid: 5804 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607672.016237:0:7437:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f46c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7437:1869199364392064:192.168.202.4@tcp:104: 00000100:00100000:3.0:1782607672.016357:0:7437:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745486ebe40 going to sleep for 11 seconds 00000100:00100000:3.0:1782607672.020388:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607672.020587:0:7437:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f46c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7437:1869199364392064:192.168.202.4@tcp:104: 00010000:00010000:2.0:1782607672.020641:0:7437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cb5bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607672.021288:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342341376 00000100:00100000:0.0:1782607672.021300:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342341376 00010000:00010000:0.0:1782607672.021363:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb5a1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd51 expref: 47 pid: 5804 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607672.021413:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 41 00000100:00100000:0.0:1782607672.021426:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f46c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+47:2356:x1869199342341376:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782607672.021451:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782607672.021460:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb5a1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd51 expref: 47 pid: 5804 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607672.021502:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb5a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd51 expref: 47 pid: 5804 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607672.021545:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb5a1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd51 expref: 47 pid: 5804 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607672.021567:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745454f5f00) 00010000:00010000:0.0:1782607672.021573:0:5787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cb5bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607672.021584:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cb5bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607672.021594:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cb5bd lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607672.021737:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782607672.021863:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f46c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+46:2356:x1869199342341376:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 436us (1488us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607672.021871:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 41 00010000:00010000:2.0:1782607672.022534:0:7437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cb5bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.022546:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cb5bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782607672.022612:0:7437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1782607672.022618:0:7437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782607672.022658:0:7437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cb5bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.022703:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cb5b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd58 expref: 46 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.022724:0:7437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cb5bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd58 expref: 45 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.022732:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745454f5f00) 00010000:00010000:2.0:1782607672.022748:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782607672.022752:0:7437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97455d648e00, rc 0) 00000100:00100000:2.0:1782607672.022848:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580e52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+45:10390:x1869199342341248:12345-192.168.202.4@tcp:101:bash.0 Request processed in 7302us (8329us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607672.022856:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 59 00000100:00100000:3.0:1782607672.027354:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607672.038133:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342341632 00000100:00100000:2.0:1782607672.038165:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342341632 00000100:00100000:2.0:1782607672.038276:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15 00000100:00100000:2.0:1782607672.038295:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549b8ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+45:10390:x1869199342341632:12345-192.168.202.4@tcp:35:bash.0 00000100:00100000:2.0:1782607672.038811:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549b8ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+46:10390:x1869199342341632:12345-192.168.202.4@tcp:35:bash.0 Request processed in 475us (11427us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1782607672.038821:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15 00000100:00100000:1.0:1782607672.173079:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607672.173201:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342341888 00000100:00100000:0.0:1782607672.173211:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342341888 00000100:00100000:0.0:1782607672.173271:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 60 00000100:00100000:0.0:1782607672.173278:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f385500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+46:10400:x1869199342341888:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1782607672.173298:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607672.173315:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cb5c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffd5f expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782607672.173446:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1782607672.173578:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cb5c4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd5f expref: 48 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607672.173592:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff974543e77800) 00010000:00010000:0.0:1782607672.173595:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782607672.173599:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cb5c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd5f expref: 48 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607672.173613:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c42600, rc 0) 00000100:00100000:0.0:1782607672.173679:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f385500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+47:10400:x1869199342341888:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 400us (607us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1782607672.173684:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 60 00000100:00100000:0.0:1782607672.177126:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607672.177250:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342342016 00000100:00100000:2.0:1782607672.177258:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342342016 00000100:00100000:2.0:1782607672.177311:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 61 00000100:00100000:2.0:1782607672.177319:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+47:10400:x1869199342342016:12345-192.168.202.4@tcp:34:lfs.0 00010000:00010000:2.0:1782607672.177392:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb5d2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.177409:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb5d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.177422:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb5d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.177437:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb5d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.177445:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb5d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.177466:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb5d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.177585:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb5e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.177594:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb5e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.177600:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb5e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782607672.177651:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb5e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.177664:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb5d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.177670:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb5d2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.177676:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb5d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.177681:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ad000 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607672.177685:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb5d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.177691:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb5d2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.177704:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97454c8e3300) 00010000:00010000:2.0:1782607672.177712:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607672.177717:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb5d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.177723:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb5d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.177735:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb5d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.177740:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb5d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.177745:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb5d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.177749:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ada00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607672.177752:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb5d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.177757:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb5d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.177762:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9745432c6000) 00010000:00010000:2.0:1782607672.177808:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607672.177811:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb5d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.177816:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb5d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.177846:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb5e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.177858:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb5e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.177863:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb5e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.177869:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585acc00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607672.177872:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb5e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.177878:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb5e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.177887:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745454f5f00) 00010000:00010000:2.0:1782607672.177889:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607672.177892:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb5e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.177898:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb5e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607672.177971:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+47:10400:x1869199342342016:12345-192.168.202.4@tcp:34:lfs.0 Request processed in 651us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607672.177978:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 61 00000100:00100000:3.0:1782607672.180682:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607672.183358:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342342272 00000100:00100000:2.0:1782607672.183372:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342342272 00000100:00100000:2.0:1782607672.183431:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16 00000100:00100000:2.0:1782607672.183440:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f46ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+47:10400:x1869199342342272:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:2.0:1782607672.183713:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f46ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+48:10400:x1869199342342272:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 274us (3040us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1782607672.183731:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16 00000100:00100000:1.0:1782607672.237304:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607672.237585:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342342528 00000100:00100000:0.0:1782607672.237595:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342342528 00000100:00100000:0.0:1782607672.237685:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 62 00000100:00100000:0.0:1782607672.237693:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+48:10403:x1869199342342528:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1782607672.237713:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607672.237729:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cb5e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffd66 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607672.237817:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cb5ee lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607672.237829:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cb5ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607672.237857:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cb5ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607672.237868:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42400/0x8109266df35cb5f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607672.237876:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42400/0x8109266df35cb5f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607672.237882:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42400/0x8109266df35cb5f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607672.237991:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb5fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607672.237998:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb5fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607672.238002:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb5fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782607672.238009:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1782607672.238093:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cb5ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607672.238097:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cb5ee lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607672.238102:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cb5ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607672.238105:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c43200 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607672.238113:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cb5ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607672.238118:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cb5ee lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607672.238127:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97454c8e3300) 00010000:00010000:0.0:1782607672.238129:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782607672.238131:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cb5ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607672.238136:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cb5ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607672.238145:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42400/0x8109266df35cb5f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607672.238150:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42400/0x8109266df35cb5f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607672.238166:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42400/0x8109266df35cb5f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607672.238171:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42400 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607672.238173:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42400/0x8109266df35cb5f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607672.238178:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42400/0x8109266df35cb5f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607672.238186:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97454c8e3600) 00010000:00010000:0.0:1782607672.238188:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782607672.238196:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42400/0x8109266df35cb5f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607672.238203:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42400/0x8109266df35cb5f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607672.238241:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cb5e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd66 expref: 51 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607672.238250:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb5fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd66 expref: 50 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607672.238254:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745454f5f00) 00010000:00010000:0.0:1782607672.238256:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782607672.238258:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c42000, rc 0) 00000100:00100000:0.0:1782607672.238313:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+50:10403:x1869199342342528:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 622us (1027us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1782607672.238318:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 62 00000100:00100000:1.0:1782607672.241421:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607672.244003:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607672.244029:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342342784 00000100:00100000:1.0:1782607672.244048:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342342784 00000100:00100000:1.0:1782607672.244105:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4 00000100:00100000:1.0:1782607672.244115:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f387800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+50:2355:x1869199342342784:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782607672.244131:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782607672.244164:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb5fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd66 expref: 50 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607672.244184:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745454f5f00) 00010000:00010000:1.0:1782607672.244203:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782607672.244251:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f387800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+49:2355:x1869199342342784:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 137us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607672.244259:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4 00000100:00100000:2.0:1782607672.248719:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342342656 00000100:00100000:2.0:1782607672.248733:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342342656 00000100:00100000:2.0:1782607672.248891:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 63 00000100:00100000:2.0:1782607672.248902:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+49:10403:x1869199342342656:12345-192.168.202.4@tcp:54:lfs.0 00010000:00010000:2.0:1782607672.248966:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb60a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.248979:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb60a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.248987:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb60a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.249008:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb60a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.249013:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb60a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.249017:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb60a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.249021:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585acc00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607672.249024:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb60a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.249028:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb60a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.249045:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745454f5f00) 00010000:00010000:2.0:1782607672.249062:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782607672.249067:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb60a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607672.249071:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb60a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607672.249136:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+49:10403:x1869199342342656:12345-192.168.202.4@tcp:54:lfs.0 Request processed in 237us (7726us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607672.249141:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 63 00000100:00100000:1.0:1782607672.259923:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607672.259996:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342343040 00000100:00100000:2.0:1782607672.260005:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342343040 00000100:00100000:2.0:1782607672.260061:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17 00000100:00100000:2.0:1782607672.260072:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f384e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+49:10403:x1869199342343040:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:2.0:1782607672.260317:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f384e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+50:10403:x1869199342343040:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 248us (406us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1782607672.260322:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17 00000004:00080000:0.0:1782607672.387548:0:7892:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 331233779626ns, next at 332233776862ns, rc = 0 00000100:00100000:2.0:1782607672.387963:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782607672.387986:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457ff1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364392192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782607672.388056:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607672.388217:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364392192 00000100:00100000:0.0:1782607672.388224:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364392192 00000100:00100000:0.0:1782607672.388296:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1782607672.388306:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97454894bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1869199364392192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782607672.388361:0:6612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782607672.388420:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97454894bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1869199364392192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607672.388427:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1782607672.388485:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782607672.388649:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457ff1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364392192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782607672.436443:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607672.436539:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342343296 00000100:00100000:0.0:1782607672.436561:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342343296 00000100:00100000:0.0:1782607672.436622:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 64 00000100:00100000:0.0:1782607672.436641:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974548948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+50:10421:x1869199342343296:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1782607672.436664:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607672.436684:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cb611 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffd6d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607672.436808:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42400/0x8109266df35cb618 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607672.436822:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42400/0x8109266df35cb618 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607672.436834:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42400/0x8109266df35cb618 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782607672.436844:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1782607672.436982:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cb611 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd6d expref: 53 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607672.436999:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42400/0x8109266df35cb618 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd6d expref: 52 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607672.437009:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745454f5f00) 00010000:00010000:0.0:1782607672.437011:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1782607672.437014:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c42400, rc 0) 00000100:00100000:0.0:1782607672.437074:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974548948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+52:10421:x1869199342343296:12345-192.168.202.4@tcp:101:cat.0 Request processed in 434us (640us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1782607672.437081:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 64 00000100:00100000:1.0:1782607672.509181:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607672.509254:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342343424 00000100:00100000:0.0:1782607672.509265:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342343424 00000100:00100000:0.0:1782607672.509331:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 65 00000100:00100000:0.0:1782607672.509341:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f384700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+52:10422:x1869199342343424:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1782607672.509368:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607672.509392:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cb626 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffd74 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607672.509466:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cb62d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607672.509480:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cb62d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607672.509492:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cb62d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782607672.509554:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1782607672.509558:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1782607672.509581:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cb62d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607672.509608:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cb626 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd74 expref: 54 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607672.509627:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cb62d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd74 expref: 53 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607672.509636:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97454c8e3300) 00010000:00010000:0.0:1782607672.509639:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782607672.509656:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c43200, rc 0) 00000100:00100000:0.0:1782607672.509723:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f384700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+53:10422:x1869199342343424:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 383us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607672.509730:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 65 00000100:00100000:1.0:1782607672.512861:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607672.512965:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342343808 00000100:00100000:3.0:1782607672.512975:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342343808 00000100:00100000:3.0:1782607672.513031:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 18 00000100:00100000:3.0:1782607672.513048:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f384380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+53:10422:x1869199342343808:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:3.0:1782607672.513387:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f384380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+54:10422:x1869199342343808:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 340us (534us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1782607672.513395:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 18 00000040:00080000:0.0:1782607672.514455:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1782607672.514735:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782607672.516672:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607672.516751:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342343936 00000100:00100000:3.0:1782607672.516761:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342343936 00000100:00100000:3.0:1782607672.516895:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5 00000100:00100000:3.0:1782607672.516907:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+54:10422:x1869199342343936:12345-192.168.202.4@tcp:103:lfs.0 00010000:00010000:3.0:1782607672.516923:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1782607672.516945:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cb5bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd58 expref: 54 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607672.516989:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42400/0x8109266df35cb618 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd6d expref: 53 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607672.517001:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cb4c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd19 expref: 52 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607672.517011:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745454f5f00) 00010000:00010000:3.0:1782607672.517021:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782607672.517084:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+51:10422:x1869199342343936:12345-192.168.202.4@tcp:103:lfs.0 Request processed in 180us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607672.517092:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5 00000100:00100000:1.0:1782607672.526322:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607672.527252:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342344064 00000100:00100000:3.0:1782607672.527262:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342344064 00000100:00100000:3.0:1782607672.527386:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 66 00000100:00100000:3.0:1782607672.527398:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+51:10422:x1869199342344064:12345-192.168.202.4@tcp:58:lfs.0 00010000:00010000:3.0:1782607672.527527:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649800/0x8109266df35cb634 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607672.527543:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649800/0x8109266df35cb634 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607672.527554:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649800/0x8109266df35cb634 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782607672.527863:0:7437:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782607672.529517:0:7437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1782607672.529601:0:7437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1782607672.530002:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+51:10422:x1869199342344064:12345-192.168.202.4@tcp:58:lfs.0 Request processed in 2600us (3685us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607672.532657:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 66 00000100:00100000:0.0:1782607672.619915:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607672.620071:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342344192 00000100:00100000:1.0:1782607672.620081:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342344192 00000100:00100000:1.0:1782607672.620157:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 67 00000100:00100000:1.0:1782607672.620169:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457ff1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+51:10424:x1869199342344192:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1782607672.620188:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607672.620209:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cb63b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffd7b expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607672.620274:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb642 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607672.620288:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb642 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607672.620298:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb642 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607672.620312:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467000/0x8109266df35cb649 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607672.620335:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467000/0x8109266df35cb649 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607672.620342:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467000/0x8109266df35cb649 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607672.620881:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cb650 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607672.620891:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cb650 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607672.620898:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cb650 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782607672.620935:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1782607672.620939:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782607672.620956:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cb650 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607672.620967:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cb650 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607672.620976:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb642 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607672.620982:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb642 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607672.620989:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb642 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607672.621005:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f466400 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607672.621010:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb642 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607672.621017:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb642 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607672.621040:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97454c8e3300) 00010000:00010000:1.0:1782607672.621044:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607672.621049:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb642 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607672.621054:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb642 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607672.621069:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467000/0x8109266df35cb649 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607672.621074:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467000/0x8109266df35cb649 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607672.621078:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467000/0x8109266df35cb649 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607672.621082:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f467000 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607672.621085:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467000/0x8109266df35cb649 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607672.621090:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467000/0x8109266df35cb649 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607672.621109:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff974543e77200) 00010000:00010000:1.0:1782607672.621111:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607672.621114:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467000/0x8109266df35cb649 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607672.621120:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467000/0x8109266df35cb649 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607672.622517:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cb63b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd7b expref: 53 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607672.622541:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cb650 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd7b expref: 52 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607672.622550:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745454f5400) 00010000:00010000:1.0:1782607672.622553:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782607672.622556:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97457f467e00, rc 0) 00000100:00100000:1.0:1782607672.622643:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457ff1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+52:10424:x1869199342344192:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 2475us (2736us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607672.622653:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 67 00000100:00100000:1.0:1782607673.411748:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457ff1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364392320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782607673.411845:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607673.411975:0:6613:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364392320 00000100:00100000:3.0:1782607673.411985:0:6613:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364392320 00000100:00100000:3.0:1782607673.412075:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1782607673.412087:0:6613:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f384000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364392320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782607673.412130:0:6613:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1782607673.413836:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782607673.416133:0:6613:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f384000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364392320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3928us (4167us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607673.416223:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1782607673.417383:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457ff1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364392320:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1782607673.546448:0:11563:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782607673.546458:0:11563:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782607673.546511:0:11563:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1782607673.546518:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782607673.546657:0:11563:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676caa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11563:1869199364392448:192.168.202.4@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1782607673.546819:0:11563:0:(client.c:2701:ptlrpc_set_wait()) set ffff974550578900 going to sleep for 11 seconds 00010000:00010000:0.0:1782607673.547296:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782607673.563286:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607673.567116:0:5815:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342344320 00000100:00100000:3.0:1782607673.567130:0:5815:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342344320 00000100:00100000:1.0:1782607673.570084:0:11563:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676caa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11563:1869199364392448:192.168.202.4@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782607673.577427:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1 00000100:00100000:3.0:1782607673.577444:0:5815:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f46c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d72d7fb9-639f-4ad9-b658-df715cbf7792+52:10435:x1869199342344320:12345-192.168.202.4@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1782607673.577534:0:5815:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f46c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d72d7fb9-639f-4ad9-b658-df715cbf7792+52:10435:x1869199342344320:12345-192.168.202.4@tcp:900:lhsmtool_posix.0 Request processed in 96us (14257us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607673.577543:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1 00000100:00080000:2.0:1782607673.582226:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1782607673.590760:0:11876:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782607673.591961:0:11876:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782607673.592132:0:11876:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1782607673.592259:0:11876:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782607673.594627:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607673.594715:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342344448 00000100:00100000:0.0:1782607673.594725:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342344448 00000100:00100000:0.0:1782607673.594829:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 68 00000100:00100000:0.0:1782607673.594840:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+52:10435:x1869199342344448:12345-192.168.202.4@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782607673.594883:0:5803:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782607673.594989:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+52:10435:x1869199342344448:12345-192.168.202.4@tcp:53:lhsmtool_posix.0 Request processed in 151us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607673.594997:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 68 00000100:00100000:0.0:1782607673.608087:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607673.611588:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342344576 00000100:00100000:2.0:1782607673.611602:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342344576 00000100:00100000:2.0:1782607673.611666:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 69 00000100:00100000:2.0:1782607673.611676:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457ff1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+52:10435:x1869199342344576:12345-192.168.202.4@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1782607673.611750:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb657 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607673.611795:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb657 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607673.611818:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb657 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607673.611833:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb65e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607673.611841:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb65e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607673.611847:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb65e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607673.611881:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb665 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607673.611890:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb665 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607673.611897:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb665 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782607673.611949:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1782607673.611954:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782607673.611966:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb665 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607673.611978:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb657 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607673.611984:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb657 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607673.611991:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb657 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607673.611996:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ace00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607673.612001:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb657 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607673.612009:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb657 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607673.612022:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97454c8e3f00) 00010000:00010000:2.0:1782607673.612025:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607673.612030:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb657 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607673.612036:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb657 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607673.612048:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb65e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607673.612063:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb65e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607673.612069:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb65e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607673.612074:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ada00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607673.612077:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb65e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607673.612082:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb65e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607673.612090:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9745432c6200) 00010000:00010000:2.0:1782607673.612093:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607673.612096:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb65e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607673.612101:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb65e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607673.612123:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb665 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607673.612128:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb665 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607673.612931:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb665 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607673.612944:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585acc00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607673.612954:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb665 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607673.612963:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb665 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607673.612975:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745454f5400) 00010000:00010000:2.0:1782607673.612978:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607673.612982:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb665 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607673.612988:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb665 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607673.613083:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457ff1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+52:10435:x1869199342344576:12345-192.168.202.4@tcp:34:lhsmtool_posix.0 Request processed in 1405us (5003us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607673.613095:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 69 00000100:00100000:2.0:1782607673.639033:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607673.639182:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342344832 00000100:00100000:1.0:1782607673.639191:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342344832 00000100:00100000:1.0:1782607673.639248:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 70 00000100:00100000:1.0:1782607673.639260:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+52:10435:x1869199342344832:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782607673.639281:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607673.639303:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467800/0x8109266df35cb66c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffd82 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607673.639412:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cb673 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607673.639426:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cb673 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607673.639438:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cb673 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782607673.639450:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1782607673.639552:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cb673 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607673.639560:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cb673 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607673.639566:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cb673 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607673.639572:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f466a00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607673.639576:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cb673 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607673.639601:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cb673 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607673.639616:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745454f5400) 00010000:00010000:1.0:1782607673.639619:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782607673.639624:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cb673 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607673.639630:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cb673 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607673.639678:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467800/0x8109266df35cb66c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd82 expref: 54 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607673.639688:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97454c8e3f00) 00010000:00010000:1.0:1782607673.639690:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782607673.639694:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467800/0x8109266df35cb66c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd82 expref: 54 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607673.639703:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97457f467800, rc 0) 00000100:00100000:1.0:1782607673.639801:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+53:10435:x1869199342344832:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 Request processed in 504us (748us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1782607673.639819:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 70 00000100:00100000:1.0:1782607673.668978:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607673.675761:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342344960 00000100:00100000:0.0:1782607673.675794:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342344960 00000100:00100000:0.0:1782607673.675878:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 71 00000100:00100000:0.0:1782607673.675888:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f385180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+53:10435:x1869199342344960:12345-192.168.202.4@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782607673.675929:0:5804:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782607673.676069:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f385180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+53:10435:x1869199342344960:12345-192.168.202.4@tcp:53:lhsmtool_posix.0 Request processed in 182us (7098us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607673.676076:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 71 00000100:00100000:0.0:1782607673.679834:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607673.681389:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342345216 00000100:00100000:3.0:1782607673.681400:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342345216 00000100:00100000:3.0:1782607673.681464:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 72 00000100:00100000:3.0:1782607673.681475:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457ff1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+53:10435:x1869199342345216:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782607673.681495:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607673.681497:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1782607673.681523:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cb62d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd74 expref: 53 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607673.681555:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97454c8e3300) 00010000:00010000:3.0:1782607673.681560:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782607673.681574:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cb681 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffd89 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782607673.682038:0:5803:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1782607673.682261:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cb688 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607673.682275:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cb688 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607673.682285:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cb688 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607673.682334:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cb681 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd89 expref: 55 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607673.682349:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cb688 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd89 expref: 54 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607673.682356:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9745454f5f00) 00010000:00010000:3.0:1782607673.682358:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782607673.682361:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97455d648e00, rc 0) 00000100:00100000:3.0:1782607673.682428:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457ff1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+54:10435:x1869199342345216:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 Request processed in 955us (2602us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1782607673.682436:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 72 00000100:00100000:0.0:1782607673.701821:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607673.704167:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342345472 00000100:00100000:3.0:1782607673.704183:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342345472 00000100:00100000:3.0:1782607673.704254:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 73 00000100:00100000:3.0:1782607673.704265:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+54:10435:x1869199342345472:12345-192.168.202.4@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782607673.704327:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782607673.704356:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cb688 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd89 expref: 54 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607673.704375:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9745454f5f00) 00010000:00010000:3.0:1782607673.704385:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782607673.704406:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648200/0x8109266df35cb696 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607673.704420:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648200/0x8109266df35cb696 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607673.704430:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648200/0x8109266df35cb696 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607673.704445:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cb69d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x833237a6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607673.704453:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cb69d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x833237a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607673.704459:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cb69d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x833237a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607673.704538:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648200/0x8109266df35cb696 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607673.704565:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648200/0x8109266df35cb696 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607673.704573:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648200/0x8109266df35cb696 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607673.704579:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d648200 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:3.0:1782607673.704584:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648200/0x8109266df35cb696 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607673.704592:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648200/0x8109266df35cb696 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607673.704600:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97454c8e3300) 00010000:00010000:3.0:1782607673.704603:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782607673.704607:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648200/0x8109266df35cb696 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607673.704613:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648200/0x8109266df35cb696 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607673.704623:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cb69d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x833237a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607673.704630:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cb69d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x833237a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607673.704636:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cb69d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x833237a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607673.704642:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d649200 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:3.0:1782607673.704650:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cb69d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x833237a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607673.704656:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cb69d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x833237a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607673.704664:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x833237a6 (ffff9745454f5a00) 00010000:00010000:3.0:1782607673.704667:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782607673.704670:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cb69d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x833237a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607673.704676:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cb69d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x833237a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607673.704782:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+53:10435:x1869199342345472:12345-192.168.202.4@tcp:36:lhsmtool_posix.0 Request processed in 498us (2960us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782607673.704790:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 73 00000100:00100000:0.0:1782607673.717828:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607673.717999:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342345600 00000100:00100000:2.0:1782607673.718008:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342345600 00000100:00100000:2.0:1782607673.718071:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 74 00000100:00100000:2.0:1782607673.718080:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+53:10435:x1869199342345600:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782607673.718104:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607673.718128:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb6a4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffd90 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607673.718186:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb6ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607673.718199:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb6ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607673.718223:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb6ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607673.718315:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb6a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd90 expref: 55 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607673.718333:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb6ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd90 expref: 54 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607673.718342:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9745432c6200) 00010000:00010000:2.0:1782607673.718345:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782607673.718349:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585ada00, rc 0) 00000100:00100000:2.0:1782607673.718406:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+54:10435:x1869199342345600:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 Request processed in 327us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607673.718414:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 74 00000100:00100000:0.0:1782607673.740342:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607673.740728:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342345856 00000100:00100000:3.0:1782607673.740738:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342345856 00000100:00100000:3.0:1782607673.740815:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 75 00000100:00100000:3.0:1782607673.740826:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745799a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+54:10435:x1869199342345856:12345-192.168.202.4@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782607673.740913:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cb6b2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607673.740929:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cb6b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607673.740940:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cb6b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782607673.741251:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1782607673.741270:0:5804:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 332587504496ns, next at 333587502361ns, rc = 0 00000004:00010000:3.0:1782607673.741373:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000677e6383 reply state 00000000d3286ac5 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cb6b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607673.741382:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782607673.741492:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745799a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+56:10435:x1869199342345856:12345-192.168.202.4@tcp:36:lhsmtool_posix.0 Request processed in 667us (1164us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1782607673.741500:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 75 00000100:00100000:1.0:1782607673.770374:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:1.0:1782607673.770408:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cb6b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607673.770421:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cb6b2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607673.770436:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cb6b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607673.770443:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d649200 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607673.770448:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cb6b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607673.770457:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cb6b2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607673.770475:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9745432c6200) 00010000:00010000:1.0:1782607673.770478:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782607673.770482:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cb6b2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607673.770489:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cb6b2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607673.770520:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342345984 00000100:00100000:1.0:1782607673.770529:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342345984 00000100:00100000:1.0:1782607673.770573:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 76 00000100:00100000:1.0:1782607673.770581:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f386300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+55:10435:x1869199342345984:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782607673.770604:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607673.770620:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467800/0x8109266df35cb6b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffd97 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607673.770673:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467800/0x8109266df35cb6b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd97 expref: 56 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607673.770698:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467800/0x8109266df35cb6b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd97 expref: 56 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607673.770716:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9745432c6200) 00010000:00010000:1.0:1782607673.770719:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782607673.770721:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97457f467800, rc 0) 00000100:00100000:1.0:1782607673.770795:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f386300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+56:10435:x1869199342345984:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 Request processed in 213us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607673.770802:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 76 00000100:00100000:1.0:1782607673.782521:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607673.782595:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342346112 00000100:00100000:3.0:1782607673.782605:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342346112 00000100:00100000:3.0:1782607673.782659:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 24 00000100:00100000:3.0:1782607673.782668:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1869199342346112:12345-192.168.202.4@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1782607673.782698:0:6610:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from d72d7fb9-639f-4ad9-b658-df715cbf7792@192.168.202.4@tcp t0 exp 0000000000000000 cur 332 last 0 00000020:00000080:3.0:1782607673.782728:0:6610:0:(genops.c:1406:class_connect()) connect: client d72d7fb9-639f-4ad9-b658-df715cbf7792, cookie 0x8109266df35cb6c0 00002000:00100000:3.0:1782607673.782739:0:6610:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d72d7fb9-639f-4ad9-b658-df715cbf7792/ffff974580f22000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782607673.782750:0:6610:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1782607673.783289:0:6610:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1782607673.783322:0:6610:0:(import.c:65:import_set_state_nolock()) ffff974547776000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782607673.783408:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2353:x1869199342346112:12345-192.168.202.4@tcp:8:lhsmtool_posix.0 Request processed in 739us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607673.783417:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 24 00000100:00100000:0.0:1782607673.802227:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607673.802313:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342346240 00000100:00100000:2.0:1782607673.802324:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342346240 00000100:00100000:2.0:1782607673.802408:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 25 00000100:00100000:2.0:1782607673.802420:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745799a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:0:x1869199342346240:12345-192.168.202.4@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1782607673.805026:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1782607673.945957:0:6634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:0.0:1782607673.945976:0:6634:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d72d7fb9-639f-4ad9-b658-df715cbf7792 00000100:00100000:0.0:1782607673.946946:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745799a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:0:x1869199342346240:12345-192.168.202.4@tcp:2:lhsmtool_posix.0 Request processed in 144521us (144726us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1782607673.946960:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 25 00000100:00100000:1.0:1782607673.951091:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607673.951310:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342346496 00000100:00100000:0.0:1782607673.951322:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342346496 00000100:00100000:0.0:1782607673.951392:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 19 00000100:00100000:0.0:1782607673.951402:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+56:10435:x1869199342346496:12345-192.168.202.4@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1782607673.951711:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+57:10435:x1869199342346496:12345-192.168.202.4@tcp:35:lhsmtool_posix.0 Request processed in 309us (627us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1782607673.951719:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 19 00000100:00100000:3.0:1782607673.964674:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607673.965146:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342346752 00000100:00100000:0.0:1782607673.965157:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342346752 00000100:00100000:0.0:1782607673.965216:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 77 00000100:00100000:0.0:1782607673.965226:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f46d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+57:10435:x1869199342346752:12345-192.168.202.4@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1782607673.965341:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f46d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+57:10435:x1869199342346752:12345-192.168.202.4@tcp:57:lhsmtool_posix.0 Request processed in 115us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607673.965348:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 77 00000100:00100000:0.0:1782607673.971199:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607673.971242:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342346880 00000100:00100000:0.0:1782607673.971251:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342346880 00000100:00100000:0.0:1782607673.971305:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 78 00000100:00100000:0.0:1782607673.971324:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745799a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+57:10435:x1869199342346880:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782607673.971345:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607673.971367:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb6c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffd9e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607673.971436:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cb6ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607673.971450:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cb6ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607673.971461:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cb6ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782607673.971495:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782607673.971513:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cb6ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607673.971539:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb6c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd9e expref: 59 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607673.971557:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cb6ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd9e expref: 58 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607673.971566:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9745432c6200) 00010000:00010000:0.0:1782607673.971569:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1782607673.971572:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c42a00, rc 0) 00000100:00100000:0.0:1782607673.971641:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745799a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+58:10435:x1869199342346880:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 Request processed in 320us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607673.971657:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 78 00000100:00100000:0.0:1782607673.983207:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607673.983891:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342347008 00000100:00100000:3.0:1782607673.983903:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342347008 00000100:00100000:3.0:1782607673.983961:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 26 00000100:00100000:3.0:1782607673.983971:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745799a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2355:x1869199342347008:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782607673.984003:0:6609:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607673.984172:0:6609:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b7c6f56/0x8109266df35cb6d5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffda5 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782607673.984204:0:6609:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a406f3a, blocks: 0x1 00010000:00010000:3.0:1782607673.984228:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=332s v=(0 0) 00010000:00010000:3.0:1782607673.984234:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782607673.984246:0:6609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b7c6f56/0x8109266df35cb6d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffda5 expref: 6 pid: 6609 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607673.984267:0:6609:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006b7c6f56/0x8109266df35cb6d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffda5 expref: 6 pid: 6609 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607673.984281:0:6609:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97455d648200, rc 0) 00000100:00100000:3.0:1782607673.984355:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745799a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2355:x1869199342347008:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 Request processed in 385us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607673.984363:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 26 00000100:00100000:0.0:1782607673.991435:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607673.993788:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342347264 00000100:00100000:1.0:1782607673.993801:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342347264 00000100:00100000:1.0:1782607673.993858:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 79 00000100:00100000:1.0:1782607673.993868:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745799a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+58:10435:x1869199342347264:12345-192.168.202.4@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1782607673.993975:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745799a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+58:10435:x1869199342347264:12345-192.168.202.4@tcp:57:lhsmtool_posix.0 Request processed in 109us (2555us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607673.993983:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 79 00000001:00080000:2.0:1782607673.996507:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967349 is committed 00000004:00080000:2.0:1782607673.996524:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1782607673.996655:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000004:00080000:2.0:1782607673.996692:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:2.0:1782607673.996702:0:5825:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9745810bf9c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1782607673.996707:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff97444257d500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9745810bf240 00000020:00080000:2.0:1782607673.996710:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff97444257de00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97457f535800 00000020:00080000:2.0:1782607673.996759:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1782607673.996869:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000001:00080000:2.0:1782607673.996883:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:2.0:1782607673.996886:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000100:00100000:1.0:1782607673.997262:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974551140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364392576:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782607673.997321:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607673.997376:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782607673.997382:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745776b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364392704:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1782607673.997403:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607673.997479:0:9088:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364392576 00000100:00100000:0.0:1782607673.997486:0:9088:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364392576 00000100:00100000:0.0:1782607673.997530:0:9088:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364392704 00000100:00100000:0.0:1782607673.997534:0:9088:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364392704 00000100:00100000:0.0:1782607673.997557:0:9088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782607673.997565:0:9088:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3318:x1869199364392576:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782607673.997592:0:9088:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1782607673.997632:0:9088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a406f37, atime: 0x6a406f37, ctime: 0x6a406f37, blocks: 0xb 00010000:00010000:0.0:1782607673.997641:0:9088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb4c435d/0x8109266df35cb6dc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607673.997657:0:9088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=332s v=(0 0) 00010000:00010000:0.0:1782607673.997662:0:9088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607673.997668:0:9088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb4c435d/0x8109266df35cb6dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607673.997685:0:9088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb4c435d/0x8109266df35cb6dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607673.997696:0:9088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb4c435d/0x8109266df35cb6dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607673.997704:0:9088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb4c435d/0x8109266df35cb6dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607673.997732:0:9088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782607673.998117:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782607673.998127:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364392704:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1782607673.998282:0:6608:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1782607673.998286:0:6608:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1782607673.998288:0:6608:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1782607673.998290:0:6608:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1782607674 -> 1782607674 00002000:00010000:2.0:1782607673.998293:0:6608:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1782607673.998332:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3318:x1869199364392704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 207us (927us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1782607673.998338:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:2.0:1782607673.998358:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782607673.998364:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb4c435d/0x8109266df35cb6dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607673.998374:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42600 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:2.0:1782607673.998378:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb4c435d/0x8109266df35cb6dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607673.998388:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb4c435d/0x8109266df35cb6dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607673.998406:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb4c435d/0x8109266df35cb6dc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607673.998424:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb4c435d/0x8109266df35cb6dc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607673.998445:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607673.998447:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607673.998449:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782607673.998737:0:9088:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3318:x1869199364392576:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1172us (1414us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1782607673.998744:0:9088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000004:00080000:1.0:1782607673.998889:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9745776b7480/2, rc 0, transno 4294967302 00000100:00100000:1.0:1782607673.998896:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745776b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364392704:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1782607673.998917:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff974551140a80/2, rc 0, transno 4294967301 00000100:00100000:1.0:1782607673.998922:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974551140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364392576:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782607673.999368:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607673.999414:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342347392 00000100:00100000:2.0:1782607673.999421:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342347392 00000100:00100000:2.0:1782607673.999479:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 29 00000100:00100000:2.0:1782607673.999487:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745799a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:10435:x1869199342347392:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782607673.999500:0:6608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607673.999518:0:6608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dbf6da63/0x8109266df35cb6e3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffdac expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607673.999542:0:6608:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006b7c6f56/0x8109266df35cb6d5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffda5 expref: 7 pid: 6609 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607673.999551:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782607673.999556:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782607673.999561:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbf6da63/0x8109266df35cb6e3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdac expref: 7 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607673.999588:0:6608:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006b7c6f56/0x8109266df35cb6d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffda5 expref: 7 pid: 6609 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607673.999622:0:6608:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006b7c6f56/0x8109266df35cb6d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffda5 expref: 7 pid: 6609 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607673.999637:0:6608:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745776b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6608:1869199364392832:192.168.202.4@tcp:104: 00000100:00100000:2.0:1782607673.999712:0:6608:0:(client.c:2701:ptlrpc_set_wait()) set ffff974550578a80 going to sleep for 11 seconds 00000100:00100000:3.0:1782607674.002793:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607674.002982:0:6608:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745776b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6608:1869199364392832:192.168.202.4@tcp:104: 00010000:00010000:2.0:1782607674.003013:0:6608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dbf6da63/0x8109266df35cb6e3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdac expref: 7 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607674.003045:0:6608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585acc00, rc 0) 00000100:00100000:2.0:1782607674.003099:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745799a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:10435:x1869199342347392:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 Request processed in 3612us (3734us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607674.003108:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 29 00000100:00100000:1.0:1782607674.003758:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342347520 00000100:00100000:1.0:1782607674.003793:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342347520 00010000:00010000:1.0:1782607674.003826:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006b7c6f56/0x8109266df35cb6d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffda5 expref: 7 pid: 6609 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607674.003859:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 42 00000100:00100000:1.0:1782607674.003868:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974548806c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:2356:x1869199342347520:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782607674.003881:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782607674.003901:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006b7c6f56/0x8109266df35cb6d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffda5 expref: 7 pid: 6609 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607674.003915:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006b7c6f56/0x8109266df35cb6d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffda5 expref: 7 pid: 6609 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607674.003936:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b7c6f56/0x8109266df35cb6d5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffda5 expref: 7 pid: 6609 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607674.003950:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607674.003954:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607674.003961:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dbf6da63/0x8109266df35cb6e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdac expref: 6 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607674.003971:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbf6da63/0x8109266df35cb6e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdac expref: 6 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607674.004014:0:5787:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000dbf6da63/0x8109266df35cb6e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdac expref: 6 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607674.004038:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f4b4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5787:1869199364392960:192.168.202.4@tcp:105: 00000100:00100000:1.0:1782607674.004100:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff974544ccbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1782607674.011627:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607674.011716:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342347648 00000100:00100000:3.0:1782607674.011727:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342347648 00002000:00100000:3.0:1782607674.011804:0:6616:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff97457f4b5180 x1869199342347648/t0(0) o4->d72d7fb9-639f-4ad9-b658-df715cbf7792@192.168.202.4@tcp:590/0 lens 504/0 e 0 to 0 dl 1782607685 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782607674.011817:0:6616:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97457f4b5180 with x1869199342347648 ext(0->8) 00002000:00010000:3.0:1782607674.011822:0:6616:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97457f4b5180 00000100:00100000:3.0:1782607674.011847:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 0 00000100:00100000:3.0:1782607674.011856:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:2356:x1869199342347648:12345-192.168.202.4@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1782607674.012456:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+9:2356:x1869199342347648:12345-192.168.202.4@tcp:4:lhsmtool_posix.0 Request processed in 599us (851us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1782607674.012464:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 0 00002000:00100000:3.0:1782607674.012471:0:6616:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff97457f4b5180 x1869199342347648/t4294967303(0) o4->d72d7fb9-639f-4ad9-b658-df715cbf7792@192.168.202.4@tcp:590/0 lens 504/448 e 0 to 0 dl 1782607685 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782607674.012480:0:6616:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97457f4b5180 with x1869199342347648 ext(0->8) 00002000:00010000:3.0:1782607674.012483:0:6616:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97457f4b5180 00000100:00100000:2.0:1782607674.013552:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f4b4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5787:1869199364392960:192.168.202.4@tcp:105: 00010000:00010000:2.0:1782607674.013577:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782607674.014711:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974548806c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+8:2356:x1869199342347520:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 10837us (11938us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607674.014723:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 42 00000100:00100000:3.0:1782607674.015795:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607674.017094:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342347776 00000100:00100000:0.0:1782607674.017104:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342347776 00000100:00100000:0.0:1782607674.017216:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 80 00000100:00100000:0.0:1782607674.017227:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f46ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+14:10435:x1869199342347776:12345-192.168.202.4@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1782607674.017363:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f46ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+14:10435:x1869199342347776:12345-192.168.202.4@tcp:44:lhsmtool_posix.0 Request processed in 138us (1572us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607674.017371:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 80 00000100:00100000:3.0:1782607674.019821:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607674.019939:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342347904 00000100:00100000:2.0:1782607674.019951:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342347904 00000100:00100000:2.0:1782607674.020009:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 30 00000100:00100000:2.0:1782607674.020019:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f46c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+8:2356:x1869199342347904:12345-192.168.202.4@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1782607674.045490:0:6634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:0.0:1782607674.045508:0:6634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:1.0:1782607674.045642:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f46c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2356:x1869199342347904:12345-192.168.202.4@tcp:16:lhsmtool_posix.0 Request processed in 25618us (25827us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607674.045655:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 30 00000100:00100000:2.0:1782607674.048103:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607674.048187:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342348160 00000100:00100000:1.0:1782607674.048196:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342348160 00000100:00100000:1.0:1782607674.048270:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 81 00000100:00100000:1.0:1782607674.048278:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745776b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+14:10435:x1869199342348160:12345-192.168.202.4@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782607674.048326:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782607674.048352:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cb6ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd9e expref: 14 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607674.048373:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9745432c6200) 00010000:00010000:1.0:1782607674.048378:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782607674.048410:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466200/0x8109266df35cb6ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607674.048420:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466200/0x8109266df35cb6ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607674.048427:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466200/0x8109266df35cb6ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782607674.048569:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000041802e7a reply state 0000000038aa1487 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466200/0x8109266df35cb6ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607674.048577:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782607674.048686:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745776b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+15:10435:x1869199342348160:12345-192.168.202.4@tcp:36:lhsmtool_posix.0 Request processed in 403us (586us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1782607674.048694:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 81 00010000:00010000:2.0:1782607674.050435:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466200/0x8109266df35cb6ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607674.050448:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466200/0x8109266df35cb6ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607674.050464:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466200/0x8109266df35cb6ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607674.050468:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f466200 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607674.050471:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466200/0x8109266df35cb6ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607674.050476:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466200/0x8109266df35cb6ea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607674.050488:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9745432c6200) 00010000:00010000:2.0:1782607674.050490:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607674.050493:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466200/0x8109266df35cb6ea lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607674.050497:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466200/0x8109266df35cb6ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607674.051418:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607674.051479:0:9088:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342348288 00000100:00100000:0.0:1782607674.051489:0:9088:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342348288 00000100:00100000:0.0:1782607674.051540:0:9088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 31 00000100:00100000:0.0:1782607674.051551:0:9088:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974541322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2357:x1869199342348288:12345-192.168.202.4@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1782607674.051817:0:9088:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1782607674.051821:0:9088:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1782607672 00002000:00010000:0.0:1782607674.051824:0:9088:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1782607671 00002000:00010000:0.0:1782607674.051826:0:9088:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1782607674 -> 1782607672 00002000:00010000:0.0:1782607674.051828:0:9088:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1782607674.051879:0:9088:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974541322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:2357:x1869199342348288:12345-192.168.202.4@tcp:2:lhsmtool_posix.0 Request processed in 330us (467us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1782607674.051896:0:9088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 31 00000100:00100000:3.0:1782607674.053684:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607674.053734:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342348544 00000100:00100000:1.0:1782607674.053743:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342348544 00000100:00100000:0.0:1782607674.054078:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 82 00000100:00100000:0.0:1782607674.054091:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f46e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+14:10435:x1869199342348544:12345-192.168.202.4@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1782607674.054172:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb6f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607674.054190:0:7437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb6ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd90 expref: 14 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607674.054198:0:7437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb6f1 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607674.054232:0:7437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb6ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd90 expref: 14 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607674.054246:0:7437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb6ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd90 expref: 14 pid: 5803 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607674.054260:0:7437:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745799a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7437:1869199364393088:192.168.202.4@tcp:104: 00000100:00100000:0.0:1782607674.054340:0:7437:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745442e2840 going to sleep for 11 seconds 00000100:00100000:3.0:1782607674.056406:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607674.056525:0:7437:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745799a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7437:1869199364393088:192.168.202.4@tcp:104: 00010000:00010000:0.0:1782607674.056552:0:7437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb6f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607674.056932:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342348672 00000100:00100000:1.0:1782607674.056939:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342348672 00010000:00010000:1.0:1782607674.056979:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb6ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd90 expref: 15 pid: 5803 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607674.057018:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 43 00000100:00100000:1.0:1782607674.057132:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f46d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+15:2357:x1869199342348672:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782607674.057158:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782607674.057166:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb6ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd90 expref: 15 pid: 5803 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607674.057179:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb6ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd90 expref: 15 pid: 5803 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607674.057203:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb6ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd90 expref: 15 pid: 5803 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607674.057222:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9745432c6200) 00010000:00010000:1.0:1782607674.057243:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb6f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607674.057253:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb6f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607674.057261:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb6f1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607674.057292:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782607674.057359:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f46d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+14:2357:x1869199342348672:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 230us (959us total) trans 0 rc 0/0 00010000:00010000:0.0:1782607674.057406:0:7437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb6f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607674.057424:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb6f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607674.057453:0:7437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb6f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607674.057461:0:7437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb6f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607674.057467:0:7437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb6f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607674.057474:0:7437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c43400 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607674.057479:0:7437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb6f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607674.057486:0:7437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb6f1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607674.057495:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9745432c6200) 00010000:00010000:0.0:1782607674.057498:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1782607674.057501:0:7437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb6f1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607674.057507:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb6f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607674.057547:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f46e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+14:10435:x1869199342348544:12345-192.168.202.4@tcp:55:lhsmtool_posix.0 Request processed in 3459us (3869us total) trans 0 rc -22/-22 00000100:00100000:0.0:1782607674.057555:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 82 00000100:00100000:1.0:1782607674.059510:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 43 00000100:00100000:2.0:1782607674.061258:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607674.061401:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342348800 00000100:00100000:1.0:1782607674.061414:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342348800 00000100:00100000:1.0:1782607674.061483:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 32 00000100:00100000:1.0:1782607674.061493:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745799e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:2356:x1869199342348800:12345-192.168.202.4@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1782607674.061537:0:6609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008b27fd35/0x8109266df35cb6f8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607674.061558:0:6609:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dbf6da63/0x8109266df35cb6e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdac expref: 7 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607674.061567:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607674.061571:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782607674.061575:0:6609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b27fd35/0x8109266df35cb6f8 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607674.061609:0:6609:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dbf6da63/0x8109266df35cb6e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdac expref: 7 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607674.061642:0:6609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dbf6da63/0x8109266df35cb6e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdac expref: 7 pid: 6608 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607674.061659:0:6609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f4b6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6609:1869199364393216:192.168.202.4@tcp:104: 00000100:00100000:1.0:1782607674.061734:0:6609:0:(client.c:2701:ptlrpc_set_wait()) set ffff974544ccb300 going to sleep for 11 seconds 00000100:00100000:3.0:1782607674.064668:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607674.064726:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342348928 00000100:00100000:0.0:1782607674.064735:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342348928 00010000:00010000:0.0:1782607674.064794:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dbf6da63/0x8109266df35cb6e3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdac expref: 8 pid: 6608 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607674.064873:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 44 00000100:00100000:0.0:1782607674.064882:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f46ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+8:2357:x1869199342348928:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782607674.064896:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782607674.064918:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dbf6da63/0x8109266df35cb6e3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdac expref: 8 pid: 6608 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607674.064932:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dbf6da63/0x8109266df35cb6e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdac expref: 8 pid: 6608 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607674.064959:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782607674.064964:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782607674.064970:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008b27fd35/0x8109266df35cb6f8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607674.064980:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b27fd35/0x8109266df35cb6f8 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607674.065001:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782607674.065495:0:6609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbf6da63/0x8109266df35cb6e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdac expref: 8 pid: 6608 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607674.065511:0:6609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f4b6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6609:1869199364393216:192.168.202.4@tcp:104: 00010000:00010000:1.0:1782607674.065529:0:6609:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008b27fd35/0x8109266df35cb6f8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607674.065539:0:6609:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008b27fd35/0x8109266df35cb6f8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607674.065545:0:6609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b27fd35/0x8109266df35cb6f8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607674.065568:0:6609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008b27fd35/0x8109266df35cb6f8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607674.065576:0:6609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b27fd35/0x8109266df35cb6f8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607674.065601:0:6609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b27fd35/0x8109266df35cb6f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607674.065608:0:6609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f467200 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:1.0:1782607674.065612:0:6609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b27fd35/0x8109266df35cb6f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607674.065620:0:6609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b27fd35/0x8109266df35cb6f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607674.065634:0:6609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b27fd35/0x8109266df35cb6f8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607674.065641:0:6609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b27fd35/0x8109266df35cb6f8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607674.065674:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f46ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:2357:x1869199342348928:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 791us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607674.065682:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 44 00000100:00100000:1.0:1782607674.067233:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745799e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2356:x1869199342348800:12345-192.168.202.4@tcp:1:lhsmtool_posix.0 Request processed in 5736us (5977us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607674.067244:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 32 00000100:00100000:2.0:1782607674.072831:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607674.072931:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342349184 00000100:00100000:1.0:1782607674.072941:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342349184 00000100:00100000:1.0:1782607674.073112:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 83 00000100:00100000:1.0:1782607674.073123:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974541323480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+13:10435:x1869199342349184:12345-192.168.202.4@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1782607674.073215:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466e00/0x8109266df35cb6ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607674.073244:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466e00/0x8109266df35cb6ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607674.073256:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466e00/0x8109266df35cb6ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607674.073469:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb706 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607674.073480:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467800/0x8109266df35cb6b9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd97 expref: 14 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607674.073488:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb706 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607674.073519:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467800/0x8109266df35cb6b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd97 expref: 14 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607674.073533:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467800/0x8109266df35cb6b9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd97 expref: 14 pid: 5803 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607674.073546:0:5805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f4b4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1869199364393344:192.168.202.4@tcp:104: 00000100:00100000:1.0:1782607674.073633:0:5805:0:(client.c:2701:ptlrpc_set_wait()) set ffff974544ccb300 going to sleep for 11 seconds 00000100:00100000:3.0:1782607674.077370:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607674.077633:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342349312 00000100:00100000:2.0:1782607674.077644:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342349312 00010000:00010000:2.0:1782607674.077686:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467800/0x8109266df35cb6b9 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd97 expref: 15 pid: 5803 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607674.077734:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 45 00000100:00100000:2.0:1782607674.077745:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f46f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+15:2357:x1869199342349312:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782607674.077808:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782607674.077833:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467800/0x8109266df35cb6b9 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd97 expref: 15 pid: 5803 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607674.077848:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467800/0x8109266df35cb6b9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd97 expref: 15 pid: 5803 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607674.077875:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9745432c6200) 00010000:00010000:2.0:1782607674.077881:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb706 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607674.077891:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb706 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607674.077899:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb706 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607674.077922:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782607674.077996:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f46f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+15:2357:x1869199342349312:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 238us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607674.078006:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 45 00010000:00010000:1.0:1782607674.079591:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467800/0x8109266df35cb6b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd97 expref: 14 pid: 5803 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607674.079626:0:5805:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f4b4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1869199364393344:192.168.202.4@tcp:104: 00010000:00010000:1.0:1782607674.079650:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb706 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607674.079675:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb706 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607674.079682:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb706 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782607674.079922:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1782607674.080104:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1782607674.080160:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1782607674.080244:0:5805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f4b4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5805:1869199364393472:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1782607674.080307:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607674.080739:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364393472 00000100:00100000:3.0:1782607674.080748:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364393472 00000100:00100000:3.0:1782607674.080823:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782607674.080834:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5805:x1869199364393472:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1782607674.080930:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5805:x1869199364393472:12345-0@lo:1000:mdt00_002.0 Request processed in 98us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607674.080938:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782607674.081255:0:5805:0:(client.c:2701:ptlrpc_set_wait()) set ffff974541376780 going to sleep for 11 seconds 00000100:00100000:1.0:1782607674.081288:0:5805:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:1.0:1782607674.081294:0:5805:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9745776b7480, transno 4294967302 00000100:00100000:1.0:1782607674.081317:0:5805:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f4b4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5805:1869199364393472:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1782607674.082500:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1782607674.082573:0:5805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f4b4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5805:1869199364393600:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1782607674.083331:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607674.083466:0:5805:0:(client.c:2701:ptlrpc_set_wait()) set ffff97456a83f540 going to sleep for 11 seconds 00000100:00100000:3.0:1782607674.083512:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364393600 00000100:00100000:3.0:1782607674.083521:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364393600 00000100:00100000:3.0:1782607674.083607:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782607674.083638:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5805:x1869199364393600:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1782607674.083980:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5805:x1869199364393600:12345-0@lo:1000:mdt00_002.0 Request processed in 343us (649us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1782607674.083996:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782607674.084081:0:5805:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f4b4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5805:1869199364393600:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1782607674.084128:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb706 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607674.084153:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb706 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607674.084161:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb706 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607674.084167:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f467600 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607674.084172:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb706 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607674.084181:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb706 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607674.084196:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9745432c6200) 00010000:00010000:0.0:1782607674.084199:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782607674.084203:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb706 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607674.084210:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb706 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607674.084252:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649800/0x8109266df35cb634 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607674.084259:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649800/0x8109266df35cb634 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607674.084264:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649800/0x8109266df35cb634 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607674.084279:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d649800 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607674.084283:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649800/0x8109266df35cb634 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607674.084289:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649800/0x8109266df35cb634 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607674.084299:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745454f5400) 00010000:00010000:0.0:1782607674.084301:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782607674.084304:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649800/0x8109266df35cb634 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607674.084308:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649800/0x8109266df35cb634 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607674.084329:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb70d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607674.084342:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cb650 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd7b expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607674.084351:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb70d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607674.084383:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cb650 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd7b expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607674.084398:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cb650 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd7b expref: 17 pid: 5805 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607674.084422:0:5805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745799a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1869199364393728:192.168.202.4@tcp:104: 00000100:00100000:0.0:1782607674.084694:0:5805:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745442e2840 going to sleep for 11 seconds 00000100:00100000:0.0:1782607674.091006:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607674.091151:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342349440 00000100:00100000:3.0:1782607674.091160:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342349440 00010000:00010000:3.0:1782607674.091197:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cb650 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd7b expref: 18 pid: 5805 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607674.091265:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 46 00000100:00100000:3.0:1782607674.091275:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745799a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+18:2357:x1869199342349440:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782607674.091290:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782607674.091296:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cb650 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd7b expref: 18 pid: 5805 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607674.091309:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cb650 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd7b expref: 18 pid: 5805 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607674.091331:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745454f5400) 00010000:00010000:3.0:1782607674.091348:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb70d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607674.091359:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb70d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607674.091367:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb70d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607674.091384:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782607674.091449:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745799a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+18:2357:x1869199342349440:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 175us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607674.091457:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 46 00010000:00010000:2.0:1782607674.091522:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cb650 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffd7b expref: 17 pid: 5805 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607674.091538:0:5805:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745799a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1869199364393728:192.168.202.4@tcp:104: 00010000:00010000:2.0:1782607674.091558:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb70d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607674.091567:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb70d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607674.091582:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb70d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607674.091597:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb70d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607674.091605:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb70d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607674.091612:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb70d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607674.091617:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c43400 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607674.091622:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb70d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607674.091629:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb70d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607674.091638:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745454f5400) 00010000:00010000:2.0:1782607674.091640:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607674.091644:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb70d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607674.091650:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cb70d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607674.091660:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466e00/0x8109266df35cb6ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607674.091666:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466e00/0x8109266df35cb6ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607674.091677:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466e00/0x8109266df35cb6ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607674.091682:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f466e00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607674.091685:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466e00/0x8109266df35cb6ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607674.091691:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466e00/0x8109266df35cb6ff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607674.091697:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745454f5400) 00010000:00010000:2.0:1782607674.091700:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782607674.091702:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466e00/0x8109266df35cb6ff lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607674.091708:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466e00/0x8109266df35cb6ff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782607674.091966:0:11563:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782607674.091971:0:11563:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782607674.091993:0:11563:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1782607674.091998:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782607674.092076:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974541323480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+16:10435:x1869199342349184:12345-192.168.202.4@tcp:57:lhsmtool_posix.0 Request processed in 18954us (19308us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1782607674.092085:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 83 00000020:00080000:2.0:1782607674.092088:0:5805:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1782607674.094624:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607674.094725:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342349696 00000100:00100000:3.0:1782607674.094736:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342349696 00000100:00100000:3.0:1782607674.094920:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 20 00000100:00100000:3.0:1782607674.094930:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745799a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+16:10435:x1869199342349696:12345-192.168.202.4@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1782607674.100053:0:5807:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1782607674.100177:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1782607674.100252:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cb714 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607674.100271:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cb714 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607674.100284:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cb714 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607674.100293:0:5807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cb714 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607674.100299:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cb714 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607674.100305:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cb714 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607674.100330:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782607674.100619:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745799a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+18:10435:x1869199342349696:12345-192.168.202.4@tcp:35:lhsmtool_posix.0 Request processed in 5685us (5999us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1782607674.100630:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 20 00000020:00080000:3.0:1782607674.100643:0:5807:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1782607674.100723:0:7513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782607674.100731:0:7513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cb714 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607674.100748:0:7513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d648e00 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:2.0:1782607674.100753:0:7513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cb714 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607674.100761:0:7513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cb714 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607674.100794:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9745454f5600) 00010000:00010000:2.0:1782607674.100797:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782607674.100802:0:7513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cb714 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607674.100809:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cb714 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607674.100825:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607674.100827:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607674.100829:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607674.562077:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607674.962282:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f4b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869199364393984:0@lo:400:kworker.0 00000100:00100000:1.0:1782607674.962367:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607674.962421:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f4b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364394496:0@lo:400:kworker.0 00000100:00100000:1.0:1782607674.962447:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607674.962477:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782607674.962484:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f4b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fae11c6e-4506-4104-bb8c-df42498f7e08:3317:1869199364393856:0@lo:400:kworker.0 00000100:00100000:1.0:1782607674.962511:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607674.962531:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f4b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3317:1869199364394368:0@lo:400:kworker.0 00000100:00100000:1.0:1782607674.962580:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607674.962614:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f4b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1869199364394112:0@lo:400:kworker.0 00000100:00100000:1.0:1782607674.962637:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607674.962654:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782607674.962658:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f4b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364394240:0@lo:400:kworker.0 00000100:00100000:1.0:1782607674.962677:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607674.962708:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364394496 00000100:00100000:1.0:1782607674.962716:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364394496 00000100:00100000:1.0:1782607674.962801:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364394240 00000100:00100000:1.0:1782607674.962805:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364394240 00000100:00100000:1.0:1782607674.962827:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1782607674.962835:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3317:x1869199364394496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607674.962886:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3317:x1869199364394496:12345-0@lo:400:kworker.0 Request processed in 51us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607674.962892:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1782607674.962908:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1782607674.962914:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3318:x1869199364394240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607674.962943:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3318:x1869199364394240:12345-0@lo:400:kworker.0 Request processed in 29us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607674.962949:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1782607674.962966:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364393856 00000100:00100000:1.0:1782607674.962969:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364393856 00000100:00100000:1.0:1782607674.962992:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1782607674.962998:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3317:x1869199364393856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607674.963155:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3317:x1869199364393856:12345-0@lo:400:kworker.0 Request processed in 156us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607674.963171:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1782607674.963220:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f4b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fae11c6e-4506-4104-bb8c-df42498f7e08:3317:1869199364393856:0@lo:400:kworker.0 00000100:00100000:1.0:1782607674.963235:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f4b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364394496:0@lo:400:kworker.0 00000100:00100000:1.0:1782607674.963262:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f4b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364394240:0@lo:400:kworker.0 00000100:00100000:0.0:1782607674.963350:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364393984 00000100:00100000:0.0:1782607674.963355:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364393984 00000100:00100000:0.0:1782607674.963389:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364394368 00000100:00100000:0.0:1782607674.963392:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364394368 00000100:00100000:0.0:1782607674.963407:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364394112 00000100:00100000:0.0:1782607674.963410:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364394112 00000100:00100000:0.0:1782607674.963425:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1782607674.963431:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869199364393984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607674.963469:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869199364393984:12345-0@lo:400:kworker.0 Request processed in 38us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607674.963475:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1782607674.963487:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1782607674.963493:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869199364394368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607674.963517:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869199364394368:12345-0@lo:400:kworker.0 Request processed in 25us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607674.963523:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1782607674.963533:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1782607674.963539:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1869199364394112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607674.963567:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1869199364394112:12345-0@lo:400:kworker.0 Request processed in 28us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607674.963582:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1782607674.963629:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f4b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3317:1869199364394368:0@lo:400:kworker.0 00000100:00100000:0.0:1782607674.963639:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f4b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869199364393984:0@lo:400:kworker.0 00000100:00100000:0.0:1782607674.963663:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f4b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1869199364394112:0@lo:400:kworker.0 00000100:00080000:0.0:1782607674.963697:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782607674.963701:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:2.0:1782607675.422428:0:11930:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782607675.422440:0:11930:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782607675.422472:0:11930:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1782607675.422476:0:11930:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782607675.573123:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607675.573274:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342349952 00000100:00100000:2.0:1782607675.573286:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342349952 00000100:00080000:0.0:1782607675.573406:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782607675.573456:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 84 00000100:00100000:2.0:1782607675.573470:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+18:10454:x1869199342349952:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1782607675.573499:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607675.573521:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb71b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffdb3 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.573866:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb722 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.573882:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb722 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.573893:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb722 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782607675.573905:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1782607675.574342:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb71b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdb3 expref: 21 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.574431:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb722 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdb3 expref: 20 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.574440:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97454c8e3300) 00010000:00010000:2.0:1782607675.574443:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782607675.574446:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585ac600, rc 0) 00000100:00100000:2.0:1782607675.574516:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+20:10454:x1869199342349952:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 1050us (1402us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1782607675.574525:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 84 00000100:00100000:3.0:1782607675.578932:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607675.579019:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342350080 00000100:00100000:1.0:1782607675.579031:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342350080 00000100:00100000:1.0:1782607675.579094:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 85 00000100:00100000:1.0:1782607675.579113:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f46e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+20:10454:x1869199342350080:12345-192.168.202.4@tcp:34:lfs.0 00010000:00010000:1.0:1782607675.579196:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467a00/0x8109266df35cb730 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.579213:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467a00/0x8109266df35cb730 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.579224:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467a00/0x8109266df35cb730 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.579237:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cb737 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.579244:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cb737 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.579250:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cb737 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.579547:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466000/0x8109266df35cb73e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.579563:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466000/0x8109266df35cb73e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.579570:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466000/0x8109266df35cb73e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782607675.579619:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466000/0x8109266df35cb73e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.579629:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467a00/0x8109266df35cb730 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.579634:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467a00/0x8109266df35cb730 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.579639:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467a00/0x8109266df35cb730 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.579643:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f467a00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607675.579646:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467a00/0x8109266df35cb730 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.579650:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467a00/0x8109266df35cb730 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.579659:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97454c8e3300) 00010000:00010000:1.0:1782607675.579661:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607675.579663:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467a00/0x8109266df35cb730 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.579667:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467a00/0x8109266df35cb730 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.579679:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cb737 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.579683:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cb737 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.579686:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cb737 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.579689:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f467c00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607675.579691:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cb737 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.579694:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cb737 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.579698:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff974543e77e00) 00010000:00010000:1.0:1782607675.579699:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607675.579701:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cb737 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.579704:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cb737 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.579712:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466000/0x8109266df35cb73e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.579716:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466000/0x8109266df35cb73e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.579719:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466000/0x8109266df35cb73e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.579725:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f466000 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607675.579727:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466000/0x8109266df35cb73e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.579730:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466000/0x8109266df35cb73e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.579734:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff974543e77200) 00010000:00010000:1.0:1782607675.579735:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607675.579736:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466000/0x8109266df35cb73e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.579739:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466000/0x8109266df35cb73e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607675.579945:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f46e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+20:10454:x1869199342350080:12345-192.168.202.4@tcp:34:lfs.0 Request processed in 838us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607675.579953:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 85 00010000:00010000:2.0:1782607675.586017:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782607675.611631:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607675.611691:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342350336 00000100:00100000:2.0:1782607675.611700:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342350336 00000100:00100000:2.0:1782607675.611754:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 86 00000100:00100000:2.0:1782607675.611792:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745799a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+20:10457:x1869199342350336:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1782607675.611830:0:7437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607675.611846:0:7437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb745 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffdba expref: -99 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.611910:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb74c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.611922:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb74c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.611929:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb74c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.611939:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb753 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.611943:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb753 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.611947:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb753 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.612236:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb75a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.612243:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb75a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.612247:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb75a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782607675.612253:0:7437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1782607675.612326:0:7437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb74c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.612331:0:7437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb74c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.612353:0:7437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb74c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.612359:0:7437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ace00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607675.612364:0:7437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb74c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.612371:0:7437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb74c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.612384:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97454c8e3300) 00010000:00010000:2.0:1782607675.612387:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607675.612392:0:7437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb74c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.612403:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb74c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.612416:0:7437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb753 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.612421:0:7437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb753 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.612426:0:7437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb753 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.612430:0:7437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ad000 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607675.612439:0:7437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb753 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.612445:0:7437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb753 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.612454:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9745432c6900) 00010000:00010000:2.0:1782607675.612456:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607675.612458:0:7437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb753 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.612461:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb753 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.612757:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb745 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdba expref: 23 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.612799:0:7437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb75a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdba expref: 22 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.612806:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745432c6700) 00010000:00010000:2.0:1782607675.612808:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782607675.612811:0:7437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585acc00, rc 0) 00000100:00100000:2.0:1782607675.612869:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745799a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+22:10457:x1869199342350336:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 1105us (1244us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1782607675.612876:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 86 00000100:00100000:1.0:1782607675.619898:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607675.619996:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342350464 00000100:00100000:0.0:1782607675.620005:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342350464 00000100:00100000:0.0:1782607675.620061:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 87 00000100:00100000:0.0:1782607675.620072:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+22:10457:x1869199342350464:12345-192.168.202.4@tcp:54:lfs.0 00010000:00010000:0.0:1782607675.620154:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42400/0x8109266df35cb768 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607675.620172:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42400/0x8109266df35cb768 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607675.620184:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42400/0x8109266df35cb768 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607675.620210:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42400/0x8109266df35cb768 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607675.620229:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42400/0x8109266df35cb768 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607675.620234:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42400/0x8109266df35cb768 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607675.620238:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42400 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607675.620241:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42400/0x8109266df35cb768 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607675.620247:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42400/0x8109266df35cb768 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607675.620255:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745432c6700) 00010000:00010000:0.0:1782607675.620257:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782607675.620260:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42400/0x8109266df35cb768 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607675.620264:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42400/0x8109266df35cb768 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607675.620396:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+22:10457:x1869199342350464:12345-192.168.202.4@tcp:54:lfs.0 Request processed in 326us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607675.620402:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 87 00000100:00100000:3.0:1782607675.621732:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607675.621882:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342350720 00000100:00100000:1.0:1782607675.621887:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342350720 00000100:00100000:1.0:1782607675.621945:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 21 00000100:00100000:1.0:1782607675.621951:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549b88c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+22:10457:x1869199342350720:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:1.0:1782607675.622147:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549b88c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+23:10457:x1869199342350720:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 195us (416us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1782607675.622154:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 21 00000100:00100000:2.0:1782607675.642068:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607675.642669:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342350976 00000100:00100000:0.0:1782607675.642681:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342350976 00000100:00100000:0.0:1782607675.642821:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 88 00000100:00100000:0.0:1782607675.642831:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974541323800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+23:9978:x1869199342350976:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:0.0:1782607675.642853:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607675.642884:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42400/0x8109266df35cb76f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffdc1 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607675.642987:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42e00/0x8109266df35cb776 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607675.642998:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb75a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdba expref: 24 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607675.643004:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42e00/0x8109266df35cb776 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607675.643038:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb75a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdba expref: 24 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607675.643051:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb75a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdba expref: 24 pid: 7437 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607675.643066:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745799a5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5803:1869199364394624:192.168.202.4@tcp:104: 00000100:00100000:0.0:1782607675.643247:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745510dd480 going to sleep for 11 seconds 00000100:00100000:0.0:1782607675.646100:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745799a5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5803:1869199364394624:192.168.202.4@tcp:104: 00010000:00010000:0.0:1782607675.646145:0:5803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42e00/0x8109266df35cb776 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607675.646369:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607675.646706:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342351104 00000100:00100000:3.0:1782607675.646713:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342351104 00010000:00010000:3.0:1782607675.646742:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb75a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdba expref: 25 pid: 7437 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607675.646890:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 47 00000100:00100000:3.0:1782607675.646898:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974541320e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+25:2356:x1869199342351104:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782607675.646909:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782607675.646914:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb75a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdba expref: 25 pid: 7437 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607675.646923:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb75a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdba expref: 25 pid: 7437 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607675.646938:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb75a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdba expref: 25 pid: 7437 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607675.646949:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745432c6700) 00010000:00010000:3.0:1782607675.646953:0:5787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42e00/0x8109266df35cb776 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607675.646959:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42e00/0x8109266df35cb776 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607675.646964:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42e00/0x8109266df35cb776 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607675.646999:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782607675.647041:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974541320e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+24:2356:x1869199342351104:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 144us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607675.647046:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 47 00010000:00010000:2.0:1782607675.647681:0:5803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42e00/0x8109266df35cb776 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.647696:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42e00/0x8109266df35cb776 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782607675.647710:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1782607675.647856:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42400/0x8109266df35cb76f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdc1 expref: 25 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.647866:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42e00/0x8109266df35cb776 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdc1 expref: 24 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.647871:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745432c6700) 00010000:00010000:2.0:1782607675.647873:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782607675.647875:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c42e00, rc 0) 00000100:00100000:2.0:1782607675.647901:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974541323800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+24:9978:x1869199342350976:12345-192.168.202.4@tcp:101:bash.0 Request processed in 5073us (5844us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1782607675.647905:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 88 00000100:00100000:2.0:1782607675.650650:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607675.650696:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342351360 00000100:00100000:3.0:1782607675.650704:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342351360 00000100:00100000:3.0:1782607675.650780:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 89 00000100:00100000:3.0:1782607675.650791:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974541320700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+24:9978:x1869199342351360:12345-192.168.202.4@tcp:36:bash.0 00010000:00010000:3.0:1782607675.651039:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cb784 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607675.651058:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cb784 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607675.651069:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cb784 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782607675.651117:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1782607675.651157:0:5805:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002f4b1bf3 reply state 00000000afa8dde3 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cb784 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607675.651166:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1782607675.651207:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1782607675.651297:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974541320700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+28:9978:x1869199342351360:12345-192.168.202.4@tcp:36:bash.0 Request processed in 508us (657us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1782607675.651305:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 89 00000020:00080000:3.0:1782607675.651309:0:5805:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1782607675.652848:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cb784 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.652858:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cb784 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.652863:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cb784 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.652867:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d648c00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607675.652870:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cb784 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.652888:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cb784 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.652900:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745432c6700) 00010000:00010000:2.0:1782607675.652902:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607675.652905:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cb784 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.652909:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cb784 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607675.654589:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607675.654636:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342351488 00000100:00100000:0.0:1782607675.654645:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342351488 00000100:00100000:0.0:1782607675.654735:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 90 00000100:00100000:0.0:1782607675.654746:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974541320380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+27:9978:x1869199342351488:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:0.0:1782607675.654795:0:7437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607675.654824:0:7437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb78b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffdc8 expref: -99 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607675.654882:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb78b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdc8 expref: 28 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607675.654896:0:7437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb78b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdc8 expref: 28 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607675.654916:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745432c6700) 00010000:00010000:0.0:1782607675.654918:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782607675.654921:0:7437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c42000, rc 0) 00000100:00100000:0.0:1782607675.654973:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974541320380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+28:9978:x1869199342351488:12345-192.168.202.4@tcp:101:bash.0 Request processed in 229us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607675.654980:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 90 00000100:00100000:3.0:1782607675.657282:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607675.657341:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342351616 00000100:00100000:1.0:1782607675.657350:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342351616 00000100:00100000:1.0:1782607675.657474:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 33 00000100:00100000:1.0:1782607675.657484:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f46dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:9978:x1869199342351616:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:1.0:1782607675.657509:0:6608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607675.657542:0:6608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091ce994d/0x8109266df35cb792 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffdcf expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782607675.657568:0:6608:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a406f38, atime: 0x6a406f37, ctime: 0x6a406f38, blocks: 0xb 00010000:00010000:1.0:1782607675.657588:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=334s v=(0 0) 00010000:00010000:1.0:1782607675.657591:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607675.657598:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091ce994d/0x8109266df35cb792 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdcf expref: 7 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.657611:0:6608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000091ce994d/0x8109266df35cb792 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdcf expref: 7 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.657620:0:6608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97457f467a00, rc 0) 00000100:00100000:1.0:1782607675.657669:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f46dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:9978:x1869199342351616:12345-192.168.202.4@tcp:101:bash.0 Request processed in 187us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607675.657675:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 33 00000100:00080000:0.0:1782607675.657967:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782607675.659472:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607675.659514:0:6614:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342351744 00000100:00100000:2.0:1782607675.659522:0:6614:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342351744 00002000:00010000:2.0:1782607675.659553:0:6614:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1782607675.659558:0:6614:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97457f4b4700 with x1869199342351744 ext(0->18446744073709551615) 00002000:00010000:2.0:1782607675.659568:0:6614:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97457f4b4700. 00000100:00100000:2.0:1782607675.659593:0:6614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1 00000100:00100000:2.0:1782607675.659612:0:6614:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:2354:x1869199342351744:12345-192.168.202.4@tcp:10:bash.0 00002000:00010000:2.0:1782607675.659973:0:6614:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1782607675.659976:0:6614:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1782607672 -> 1782607676 00002000:00010000:2.0:1782607675.659978:0:6614:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1782607671 -> 1782607671 00002000:00010000:2.0:1782607675.659980:0:6614:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1782607672 -> 1782607676 00002000:00010000:2.0:1782607675.659981:0:6614:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1782607675.660027:0:6614:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+8:2354:x1869199342351744:12345-192.168.202.4@tcp:10:bash.0 Request processed in 425us (559us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1782607675.660034:0:6614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1 00002000:00010000:2.0:1782607675.660052:0:6614:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1782607675.660054:0:6614:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97457f4b4700 with x1869199342351744 ext(0->18446744073709551615) 00002000:00010000:2.0:1782607675.660059:0:6614:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97457f4b4700. 00000100:00100000:3.0:1782607675.718538:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607675.718657:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342351872 00000100:00100000:2.0:1782607675.718667:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342351872 00000100:00100000:2.0:1782607675.718727:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 91 00000100:00100000:2.0:1782607675.718738:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f46df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+28:10471:x1869199342351872:12345-192.168.202.4@tcp:34:lfs.0 00010000:00010000:2.0:1782607675.718836:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb799 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.718850:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb799 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.718858:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb799 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.718869:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb7a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.718873:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb7a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.718877:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb7a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.719119:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb7a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.719136:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb7a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.719141:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb7a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782607675.719179:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb7a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.719187:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb799 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.719191:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb799 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.719196:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb799 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.719199:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585acc00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607675.719202:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb799 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.719206:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb799 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.719214:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97454c8e3300) 00010000:00010000:2.0:1782607675.719216:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607675.719219:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb799 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.719222:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb799 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.719230:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb7a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.719233:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb7a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.719240:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb7a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.719243:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ada00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607675.719245:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb7a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.719248:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb7a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.719252:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9745432c6900) 00010000:00010000:2.0:1782607675.719254:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607675.719255:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb7a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.719258:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb7a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.719272:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb7a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.719275:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb7a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.719278:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb7a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.719280:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ace00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607675.719282:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb7a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.719291:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb7a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.719295:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745432c6700) 00010000:00010000:2.0:1782607675.719297:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607675.719298:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb7a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.719301:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb7a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607675.719420:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f46df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+28:10471:x1869199342351872:12345-192.168.202.4@tcp:34:lfs.0 Request processed in 685us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607675.719426:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 91 00000100:00100000:3.0:1782607675.766735:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607675.766920:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342352128 00000100:00100000:2.0:1782607675.766928:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342352128 00000100:00100000:2.0:1782607675.766978:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 92 00000100:00100000:2.0:1782607675.766988:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f46ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+28:10474:x1869199342352128:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1782607675.767008:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607675.767035:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb7ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffdd6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.767183:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb7b5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.767195:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb7b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.767203:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb7b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.767224:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb7bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.767229:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb7bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.767233:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb7bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.767720:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb7c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.767727:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb7c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.767732:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb7c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782607675.767739:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1782607675.767862:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb7b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.767871:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb7b5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.767877:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb7b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.767883:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ada00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607675.767887:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb7b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.767905:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb7b5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.767915:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97454c8e3300) 00010000:00010000:2.0:1782607675.767917:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607675.767921:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb7b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.767924:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb7b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.767934:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb7bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.767937:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb7bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.767940:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb7bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.767944:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585acc00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607675.767945:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb7bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.767948:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb7bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.767952:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9745432c6900) 00010000:00010000:2.0:1782607675.767953:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607675.767955:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb7bc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.767964:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb7bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.768000:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb7ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdd6 expref: 31 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.768018:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb7c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdd6 expref: 30 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.768023:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745432c6700) 00010000:00010000:2.0:1782607675.768024:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1782607675.768026:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585ad000, rc 0) 00000100:00100000:2.0:1782607675.768083:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f46ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+30:10474:x1869199342352128:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 1092us (1350us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1782607675.768091:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 92 00000100:00100000:1.0:1782607675.770496:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607675.770547:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342352256 00000100:00100000:2.0:1782607675.770554:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342352256 00000100:00100000:2.0:1782607675.770610:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 93 00000100:00100000:2.0:1782607675.770620:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+30:10474:x1869199342352256:12345-192.168.202.4@tcp:54:lfs.0 00010000:00010000:2.0:1782607675.770680:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cb7d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.770692:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42e00/0x8109266df35cb776 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdc1 expref: 30 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.770698:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cb7d1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.770738:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42e00/0x8109266df35cb776 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdc1 expref: 30 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.770747:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42e00/0x8109266df35cb776 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdc1 expref: 30 pid: 5803 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607675.770757:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974541320a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5804:1869199364394752:192.168.202.4@tcp:104: 00000100:00100000:2.0:1782607675.770860:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff97457f45f180 going to sleep for 11 seconds 00000100:00100000:2.0:1782607675.772827:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974541320a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5804:1869199364394752:192.168.202.4@tcp:104: 00010000:00010000:2.0:1782607675.772856:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cb7d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607675.773012:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607675.773197:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342352512 00000100:00100000:0.0:1782607675.773203:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342352512 00000100:00100000:0.0:1782607675.773267:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 22 00000100:00100000:0.0:1782607675.773274:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+31:5569:x1869199342352512:12345-192.168.202.4@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1782607675.773521:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+32:5569:x1869199342352512:12345-192.168.202.4@tcp:35:ldlm_bl.0 Request processed in 247us (516us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1782607675.773529:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 22 00000100:00100000:3.0:1782607675.775031:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607675.775082:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342352640 00000100:00100000:0.0:1782607675.775089:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342352640 00010000:00010000:0.0:1782607675.775122:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42e00/0x8109266df35cb776 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdc1 expref: 32 pid: 5803 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607675.775189:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 48 00000100:00100000:0.0:1782607675.775195:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f46d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+32:2356:x1869199342352640:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782607675.775207:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782607675.775213:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42e00/0x8109266df35cb776 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdc1 expref: 32 pid: 5803 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607675.775221:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42e00/0x8109266df35cb776 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdc1 expref: 32 pid: 5803 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607675.775237:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42e00/0x8109266df35cb776 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdc1 expref: 32 pid: 5803 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607675.775248:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745432c6700) 00010000:00010000:0.0:1782607675.775251:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cb7d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607675.775258:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cb7d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607675.775262:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cb7d1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607675.775284:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782607675.775311:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cb7d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607675.775319:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cb7d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607675.775328:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f46d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+31:2356:x1869199342352640:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 133us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607675.775334:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 48 00010000:00010000:3.0:1782607675.775347:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cb7d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607675.775354:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cb7d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607675.775360:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cb7d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607675.775366:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974540030600 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:3.0:1782607675.775369:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cb7d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607675.775376:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cb7d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607675.775385:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745432c6700) 00010000:00010000:3.0:1782607675.775387:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782607675.775391:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cb7d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607675.775396:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cb7d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607675.775429:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+30:10474:x1869199342352256:12345-192.168.202.4@tcp:54:lfs.0 Request processed in 4811us (4947us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607675.775442:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 93 00000100:00100000:3.0:1782607675.777440:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607675.777554:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342352896 00000100:00100000:1.0:1782607675.777561:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342352896 00000100:00100000:1.0:1782607675.777597:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 23 00000100:00100000:1.0:1782607675.777604:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f46c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+30:10474:x1869199342352896:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:1.0:1782607675.777820:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f46c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+31:10474:x1869199342352896:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 215us (386us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1782607675.777827:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 23 00000100:00100000:0.0:1782607675.859385:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607675.859532:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342353152 00000100:00100000:2.0:1782607675.859546:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342353152 00000100:00100000:2.0:1782607675.859633:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 94 00000100:00100000:2.0:1782607675.859646:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745799a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+31:10485:x1869199342353152:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1782607675.859679:0:7437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607675.859703:0:7437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974540030000/0x8109266df35cb7d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffddd expref: -99 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.859853:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cb7df lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.859874:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cb7df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.859890:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cb7df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.859917:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb7e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.859925:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb7e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.859932:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb7e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.860447:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb7ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.860458:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb7ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.860466:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb7ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782607675.860482:0:7437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1782607675.860623:0:7437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cb7df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.860631:0:7437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cb7df lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.860639:0:7437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cb7df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.860647:0:7437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974540030600 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607675.860653:0:7437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cb7df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.860675:0:7437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cb7df lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.860690:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97454c8e3300) 00010000:00010000:2.0:1782607675.860693:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607675.860698:0:7437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cb7df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.860705:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cb7df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.860721:0:7437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb7e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.860727:0:7437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb7e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.860735:0:7437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb7e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.860740:0:7437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ace00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607675.860743:0:7437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb7e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.860748:0:7437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb7e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.860755:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9745432c6900) 00010000:00010000:2.0:1782607675.860757:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607675.860760:0:7437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb7e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.861261:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb7e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.861478:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974540030000/0x8109266df35cb7d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffddd expref: 34 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.861498:0:7437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb7ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffddd expref: 33 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.861507:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745432c6700) 00010000:00010000:2.0:1782607675.861510:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782607675.861513:0:7437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585acc00, rc 0) 00000100:00100000:2.0:1782607675.862333:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745799a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+33:10485:x1869199342353152:12345-192.168.202.4@tcp:101:cat.0 Request processed in 2681us (2953us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1782607675.862359:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 94 00000100:00100000:3.0:1782607675.874220:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607675.874395:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342353408 00000100:00100000:1.0:1782607675.874406:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342353408 00000100:00100000:1.0:1782607675.874475:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 24 00000100:00100000:1.0:1782607675.874485:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f46c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+33:10485:x1869199342353408:12345-192.168.202.4@tcp:35:cat.0 00000100:00100000:1.0:1782607675.874976:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f46c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+34:10485:x1869199342353408:12345-192.168.202.4@tcp:35:cat.0 Request processed in 492us (770us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1782607675.874985:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 24 00000100:00100000:0.0:1782607675.899997:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607675.900088:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342353664 00000100:00100000:3.0:1782607675.900095:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342353664 00000100:00100000:3.0:1782607675.900160:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 95 00000100:00100000:3.0:1782607675.900169:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745799a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+34:10486:x1869199342353664:12345-192.168.202.4@tcp:36:rm.0 00010000:00010000:3.0:1782607675.900230:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1782607675.900252:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb7ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffddd expref: 34 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607675.900266:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb7c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdd6 expref: 33 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607675.900274:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb78b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdc8 expref: 32 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607675.900281:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745432c6700) 00010000:00010000:3.0:1782607675.900293:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782607675.900308:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cb7fb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607675.900318:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cb7fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607675.900324:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cb7fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607675.900370:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cb802 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607675.900377:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cb802 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607675.900385:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cb802 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607675.900651:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cb809 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607675.900657:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cb809 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607675.900662:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cb809 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782607675.901296:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1782607675.901306:0:5805:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 334747539876ns, next at 335747537584ns, rc = 0 00010000:00010000:3.0:1782607675.901367:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649800/0x8109266df35cb810 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607675.901376:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649800/0x8109266df35cb810 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607675.901384:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649800/0x8109266df35cb810 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607675.901397:0:5805:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649800/0x8109266df35cb810 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607675.901414:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649800/0x8109266df35cb810 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607675.901420:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649800/0x8109266df35cb810 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607675.901436:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782607675.901460:0:7513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782607675.901464:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cb809 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.901466:0:7513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649800/0x8109266df35cb810 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607675.901470:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cb809 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607675.901477:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cb809 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.901479:0:7513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d649800 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:3.0:1782607675.901482:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d648e00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607675.901483:0:7513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649800/0x8109266df35cb810 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607675.901486:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cb809 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.901490:0:7513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649800/0x8109266df35cb810 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607675.901491:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cb809 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.901501:0:7513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745454f5d00) 00010000:00010000:2.0:1782607675.901504:0:7513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782607675.901512:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9745454f5d00) 00010000:00010000:2.0:1782607675.901513:0:7513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649800/0x8109266df35cb810 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607675.901514:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782607675.901517:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cb809 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.901519:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649800/0x8109266df35cb810 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607675.901522:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cb809 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.901533:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607675.901535:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607675.901536:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cb7fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.901537:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607675.901546:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cb7fb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607675.901551:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cb7fb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607675.901557:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d649a00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:3.0:1782607675.901559:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cb7fb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607675.901563:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cb7fb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607675.901568:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97454c8e3300) 00010000:00010000:3.0:1782607675.901569:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782607675.901571:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cb7fb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607675.901574:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cb7fb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782607675.901581:0:5805:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fd79437c reply state 0000000073de28f8 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cb802 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607675.901588:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782607675.901660:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745799a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+33:10486:x1869199342353664:12345-192.168.202.4@tcp:36:rm.0 Request processed in 1489us (1676us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1782607675.901667:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 95 00010000:00010000:1.0:1782607675.903257:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cb802 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.903267:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cb802 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.903271:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cb802 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.903275:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d648c00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607675.903278:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cb802 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.903282:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cb802 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.903292:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9745454f5500) 00010000:00010000:1.0:1782607675.903294:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607675.903297:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cb802 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.903301:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cb802 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607675.932940:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607675.933082:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342353920 00000100:00100000:2.0:1782607675.933091:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342353920 00000100:00100000:2.0:1782607675.933190:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 96 00000100:00100000:2.0:1782607675.933200:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745799a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+32:10492:x1869199342353920:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:2.0:1782607675.933223:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607675.933241:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb817 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffde4 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.933411:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb81e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.933426:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb81e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.933436:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb81e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.933450:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb825 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.933457:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb825 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.933477:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb825 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782607675.934281:0:5803:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1782607675.934488:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb82c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.934495:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb82c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.934501:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb82c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.934524:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb81e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.934529:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb81e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.934534:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb81e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.934538:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585acc00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607675.934540:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb81e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.934545:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb81e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.934553:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97454c8e3300) 00010000:00010000:2.0:1782607675.934554:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607675.934563:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb81e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.934567:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb81e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782607675.934577:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000f1fb596 reply state 0000000073f0e7e5 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb825 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607675.934583:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782607675.934609:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb817 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffde4 expref: 35 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.934622:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb82c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffde4 expref: 34 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607675.934629:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9745432c6600) 00010000:00010000:2.0:1782607675.934632:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782607675.934634:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585ace00, rc 0) 00000100:00100000:2.0:1782607675.934704:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745799a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+35:10492:x1869199342353920:12345-192.168.202.4@tcp:101:bash.0 Request processed in 1501us (1768us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1782607675.934713:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 96 00010000:00010000:1.0:1782607675.935908:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb825 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.935917:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb825 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.935920:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb825 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.935924:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ada00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607675.935926:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb825 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.935930:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb825 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.935940:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9745432c6900) 00010000:00010000:1.0:1782607675.935942:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607675.935944:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb825 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.935947:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb825 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607675.938003:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607675.938081:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342354048 00000100:00100000:1.0:1782607675.938090:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342354048 00000100:00100000:1.0:1782607675.938178:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 34 00000100:00100000:1.0:1782607675.938186:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745799a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2355:x1869199342354048:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:1.0:1782607675.938204:0:6609:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607675.938232:0:6609:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096c28144/0x8109266df35cb83a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffdeb expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782607675.938252:0:6609:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782607675.938268:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=334s v=(0 0) 00010000:00010000:1.0:1782607675.938272:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607675.938279:0:6609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096c28144/0x8109266df35cb83a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdeb expref: 6 pid: 6609 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.938292:0:6609:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000096c28144/0x8109266df35cb83a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdeb expref: 6 pid: 6609 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.938302:0:6609:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97457f466600, rc 0) 00000100:00100000:1.0:1782607675.938475:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745799a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2355:x1869199342354048:12345-192.168.202.4@tcp:101:bash.0 Request processed in 290us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607675.938480:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 34 00000100:00080000:0.0:1782607675.942264:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782607675.945410:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607675.945472:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342354176 00000100:00100000:1.0:1782607675.945479:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342354176 00000100:00100000:1.0:1782607675.945521:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 35 00000100:00100000:1.0:1782607675.945528:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974541320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:10492:x1869199342354176:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:1.0:1782607675.945547:0:6608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607675.945562:0:6608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a03132c/0x8109266df35cb841 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffdf2 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.945588:0:6608:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000096c28144/0x8109266df35cb83a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdeb expref: 7 pid: 6609 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.945610:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607675.945613:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607675.945617:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a03132c/0x8109266df35cb841 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdf2 expref: 7 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.945648:0:6608:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000096c28144/0x8109266df35cb83a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdeb expref: 7 pid: 6609 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.945658:0:6608:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000096c28144/0x8109266df35cb83a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdeb expref: 7 pid: 6609 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607675.945668:0:6608:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f4b6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6608:1869199364394880:192.168.202.4@tcp:104: 00000100:00100000:1.0:1782607675.945745:0:6608:0:(client.c:2701:ptlrpc_set_wait()) set ffff97456a83fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1782607675.948225:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607675.948320:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342354304 00000100:00100000:0.0:1782607675.948327:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342354304 00010000:00010000:0.0:1782607675.948366:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000096c28144/0x8109266df35cb83a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdeb expref: 8 pid: 6609 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607675.948396:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 49 00000100:00100000:0.0:1782607675.948402:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974548804c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+8:2357:x1869199342354304:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782607675.948413:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782607675.948431:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000096c28144/0x8109266df35cb83a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdeb expref: 8 pid: 6609 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607675.948441:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000096c28144/0x8109266df35cb83a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdeb expref: 8 pid: 6609 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607675.948461:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607675.948465:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607675.948471:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008a03132c/0x8109266df35cb841 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdf2 expref: 8 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607675.948478:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a03132c/0x8109266df35cb841 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdf2 expref: 8 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607675.948508:0:5787:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008a03132c/0x8109266df35cb841 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdf2 expref: 8 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607675.948530:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745799a5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5787:1869199364395008:192.168.202.4@tcp:105: 00000100:00100000:0.0:1782607675.948593:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745510dd480 going to sleep for 11 seconds 00010000:00010000:1.0:1782607675.949496:0:6608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096c28144/0x8109266df35cb83a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdeb expref: 8 pid: 6609 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607675.949509:0:6608:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f4b6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6608:1869199364394880:192.168.202.4@tcp:104: 00010000:00010000:1.0:1782607675.949527:0:6608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008a03132c/0x8109266df35cb841 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdf2 expref: 7 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607675.949535:0:6608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97457f466400, rc 0) 00000100:00100000:1.0:1782607675.949565:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974541320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:10492:x1869199342354176:12345-192.168.202.4@tcp:101:bash.0 Request processed in 4038us (4165us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607675.949580:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 35 00000100:00100000:1.0:1782607675.950739:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745799a5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5787:1869199364395008:192.168.202.4@tcp:105: 00010000:00010000:1.0:1782607675.950756:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782607675.950805:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974548804c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2357:x1869199342354304:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 2402us (2586us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607675.950813:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 49 00000100:00100000:3.0:1782607675.956443:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607675.956549:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342354560 00000100:00100000:1.0:1782607675.956560:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342354560 00000100:00100000:1.0:1782607675.956616:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 25 00000100:00100000:1.0:1782607675.956627:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f46f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+34:10492:x1869199342354560:12345-192.168.202.4@tcp:35:bash.0 00000100:00100000:1.0:1782607675.957326:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f46f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+35:10492:x1869199342354560:12345-192.168.202.4@tcp:35:bash.0 Request processed in 698us (891us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1782607675.957336:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 25 00000001:00080000:0.0:1782607676.026332:0:7525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:0.0:1782607676.071980:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607676.072163:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342354688 00000100:00100000:2.0:1782607676.072174:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342354688 00000100:00100000:2.0:1782607676.072285:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 97 00000100:00100000:2.0:1782607676.072297:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745799a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+35:10508:x1869199342354688:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1782607676.072322:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607676.072354:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb848 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffdf9 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.072445:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb84f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.072462:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb84f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.072473:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb84f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782607676.072543:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1782607676.072547:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1782607676.072570:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb84f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.072598:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb848 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdf9 expref: 37 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.072617:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb84f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdf9 expref: 36 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.072627:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97454c8e3300) 00010000:00010000:2.0:1782607676.072630:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782607676.072633:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585ad000, rc 0) 00000100:00100000:2.0:1782607676.072707:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745799a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+36:10508:x1869199342354688:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 412us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607676.072714:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 97 00000100:00100000:0.0:1782607676.077401:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607676.077543:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342354944 00000100:00100000:2.0:1782607676.077555:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342354944 00000100:00100000:2.0:1782607676.077731:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 98 00000100:00100000:2.0:1782607676.077742:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745799a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+36:10508:x1869199342354944:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1782607676.077787:0:7437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607676.077807:0:7437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb856 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffe00 expref: -99 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.077910:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974540030000/0x8109266df35cb85d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.077924:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974540030000/0x8109266df35cb85d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.077935:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974540030000/0x8109266df35cb85d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782607676.077947:0:7437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1782607676.078083:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb856 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe00 expref: 39 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.078102:0:7437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974540030000/0x8109266df35cb85d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe00 expref: 38 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.078111:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9745432c6600) 00010000:00010000:2.0:1782607676.078114:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782607676.078117:0:7437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974540030000, rc 0) 00000100:00100000:2.0:1782607676.078191:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745799a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+38:10508:x1869199342354944:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 450us (801us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1782607676.078199:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 98 00000100:00100000:3.0:1782607676.081507:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607676.084109:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607676.084167:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342355328 00000100:00100000:3.0:1782607676.084177:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342355328 00000100:00100000:3.0:1782607676.084238:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 6 00000100:00100000:3.0:1782607676.084248:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f46d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+38:2357:x1869199342355328:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782607676.084263:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782607676.084288:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974540030000/0x8109266df35cb85d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe00 expref: 38 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607676.084310:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9745432c6600) 00010000:00010000:3.0:1782607676.084314:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782607676.084382:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f46d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+37:2357:x1869199342355328:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 134us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607676.084389:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 6 00000100:00100000:0.0:1782607676.085083:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342355200 00000100:00100000:0.0:1782607676.085090:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342355200 00000100:00100000:0.0:1782607676.085177:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 99 00000100:00100000:0.0:1782607676.085186:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f46f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+37:10508:x1869199342355200:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1782607676.085205:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607676.085221:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43800/0x8109266df35cb86b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffe07 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607676.085310:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb872 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607676.085323:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb872 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607676.085333:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb872 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782607676.085360:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1782607676.085482:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43800/0x8109266df35cb86b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe07 expref: 40 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607676.085497:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb872 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe07 expref: 39 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607676.085517:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9745432c6600) 00010000:00010000:0.0:1782607676.085520:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1782607676.085523:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c42c00, rc 0) 00000100:00100000:0.0:1782607676.085552:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f46f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+39:10508:x1869199342355200:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 368us (4056us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1782607676.085559:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 99 00000100:00100000:3.0:1782607676.095719:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607676.096186:0:9088:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342355456 00000100:00100000:2.0:1782607676.096211:0:9088:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342355456 00000100:00100000:2.0:1782607676.096273:0:9088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 36 00000100:00100000:2.0:1782607676.096283:0:9088:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f46ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2356:x1869199342355456:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:2.0:1782607676.096341:0:9088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000100f59d9/0x8109266df35cb880 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.096369:0:9088:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008a03132c/0x8109266df35cb841 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdf2 expref: 6 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.096378:0:9088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782607676.096382:0:9088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782607676.096386:0:9088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000100f59d9/0x8109266df35cb880 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.096423:0:9088:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008a03132c/0x8109266df35cb841 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdf2 expref: 6 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.096438:0:9088:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008a03132c/0x8109266df35cb841 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdf2 expref: 6 pid: 6608 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607676.096456:0:9088:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974541320000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9088:1869199364395136:192.168.202.4@tcp:104: 00000100:00100000:2.0:1782607676.096548:0:9088:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745486eb240 going to sleep for 11 seconds 00000100:00100000:3.0:1782607676.100419:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607676.100522:0:9088:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974541320000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9088:1869199364395136:192.168.202.4@tcp:104: 00010000:00010000:2.0:1782607676.100549:0:9088:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000100f59d9/0x8109266df35cb880 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607676.100658:0:6615:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342355584 00000100:00100000:0.0:1782607676.100664:0:6615:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342355584 00002000:00100000:0.0:1782607676.100698:0:6615:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff97457f46f100 x1869199342355584/t0(0) o4->d72d7fb9-639f-4ad9-b658-df715cbf7792@192.168.202.4@tcp:592/0 lens 504/0 e 0 to 0 dl 1782607687 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782607676.100705:0:6615:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97457f46f100 with x1869199342355584 ext(0->8) 00010000:00010000:0.0:1782607676.100710:0:6615:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008a03132c/0x8109266df35cb841 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdf2 expref: 7 pid: 6608 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607676.100721:0:6615:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008a03132c/0x8109266df35cb841 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdf2 expref: 7 pid: 6608 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782607676.100726:0:6615:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff97457f46f100 00000100:00100000:0.0:1782607676.100750:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1 00000100:00100000:0.0:1782607676.100756:0:6615:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f46f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:2356:x1869199342355584:12345-192.168.202.4@tcp:4:lfs.0 00000100:00100000:0.0:1782607676.101329:0:6615:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f46f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+9:2356:x1869199342355584:12345-192.168.202.4@tcp:4:lfs.0 Request processed in 571us (920us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1782607676.101335:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1 00002000:00100000:0.0:1782607676.101340:0:6615:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff97457f46f100 x1869199342355584/t4294967302(0) o4->d72d7fb9-639f-4ad9-b658-df715cbf7792@192.168.202.4@tcp:592/0 lens 504/448 e 0 to 0 dl 1782607687 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782607676.101349:0:6615:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97457f46f100 with x1869199342355584 ext(0->8) 00010000:00010000:0.0:1782607676.101353:0:6615:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008a03132c/0x8109266df35cb841 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdf2 expref: 9 pid: 6608 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607676.101362:0:6615:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008a03132c/0x8109266df35cb841 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdf2 expref: 9 pid: 6608 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782607676.101367:0:6615:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff97457f46f100 00000100:00100000:3.0:1782607676.103845:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607676.103923:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342355712 00000100:00100000:1.0:1782607676.103930:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342355712 00010000:00010000:1.0:1782607676.103964:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008a03132c/0x8109266df35cb841 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdf2 expref: 9 pid: 6608 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607676.103996:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 50 00000100:00100000:1.0:1782607676.104012:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f46d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+9:2354:x1869199342355712:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782607676.104026:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1782607676.104043:0:5787:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1782607676.104046:0:5787:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1782607676 00002000:00010000:1.0:1782607676.104047:0:5787:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1782607677 00002000:00010000:1.0:1782607676.104049:0:5787:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1782607676 00010000:00010000:1.0:1782607676.104064:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008a03132c/0x8109266df35cb841 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdf2 expref: 9 pid: 6608 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.104074:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008a03132c/0x8109266df35cb841 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdf2 expref: 9 pid: 6608 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.104091:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a03132c/0x8109266df35cb841 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdf2 expref: 9 pid: 6608 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.104104:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782607676.104109:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782607676.104114:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000100f59d9/0x8109266df35cb880 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.104135:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000100f59d9/0x8109266df35cb880 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.104169:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782607676.104209:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f46d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+8:2354:x1869199342355712:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 207us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607676.104214:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 50 00010000:00010000:2.0:1782607676.104561:0:9088:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000100f59d9/0x8109266df35cb880 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.104573:0:9088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000100f59d9/0x8109266df35cb880 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.104598:0:9088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000100f59d9/0x8109266df35cb880 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.104606:0:9088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000100f59d9/0x8109266df35cb880 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.104612:0:9088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000100f59d9/0x8109266df35cb880 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.104618:0:9088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974540030600 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:2.0:1782607676.104622:0:9088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000100f59d9/0x8109266df35cb880 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.104632:0:9088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000100f59d9/0x8109266df35cb880 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.104645:0:9088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000100f59d9/0x8109266df35cb880 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.104661:0:9088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000100f59d9/0x8109266df35cb880 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607676.104719:0:9088:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f46ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:2356:x1869199342355456:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 8438us (9012us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607676.104727:0:9088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 36 00000100:00100000:3.0:1782607676.110017:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607676.110174:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342355968 00000100:00100000:0.0:1782607676.110184:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342355968 00000100:00100000:0.0:1782607676.110230:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 26 00000100:00100000:0.0:1782607676.110239:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549b88050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+39:10508:x1869199342355968:12345-192.168.202.4@tcp:35:lfs.0 00000004:00010000:0.0:1782607676.110300:0:5807:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb872 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe07 expref: 39 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782607676.110563:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1782607676.110621:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1782607676.110983:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1782607676.111036:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb887 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607676.111053:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb82c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffde4 expref: 43 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607676.111062:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb887 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607676.111099:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb82c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffde4 expref: 43 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607676.111134:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb82c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffde4 expref: 43 pid: 5803 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607676.111151:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745799a5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5807:1869199364395264:192.168.202.4@tcp:104: 00000100:00100000:0.0:1782607676.111301:0:5807:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745510ddcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782607676.116085:0:5807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745799a5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5807:1869199364395264:192.168.202.4@tcp:104: 00010000:00010000:3.0:1782607676.116117:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb887 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607676.117173:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607676.117642:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342356096 00000100:00100000:0.0:1782607676.117651:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342356096 00010000:00010000:0.0:1782607676.117698:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb82c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffde4 expref: 44 pid: 5803 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607676.117855:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 51 00000100:00100000:0.0:1782607676.117867:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f384e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+44:2357:x1869199342356096:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782607676.117884:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782607676.117891:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb82c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffde4 expref: 44 pid: 5803 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607676.117905:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb82c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffde4 expref: 44 pid: 5803 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607676.117927:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb82c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffde4 expref: 44 pid: 5803 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607676.117949:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9745432c6600) 00010000:00010000:0.0:1782607676.117955:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb887 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607676.117987:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb887 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607676.117995:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb887 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607676.118033:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782607676.118085:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f384e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+43:2357:x1869199342356096:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 220us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607676.118093:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 51 00010000:00010000:3.0:1782607676.118321:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb887 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607676.118330:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb887 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782607676.118488:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1782607676.118692:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1782607676.118840:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f384380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5807:1869199364395392:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1782607676.118889:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607676.118913:0:5807:0:(client.c:2701:ptlrpc_set_wait()) set ffff974550578900 going to sleep for 11 seconds 00000100:00100000:2.0:1782607676.118977:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364395392 00000100:00100000:2.0:1782607676.118982:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364395392 00000100:00100000:2.0:1782607676.119037:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782607676.119045:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f385880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5807:x1869199364395392:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1782607676.119117:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f385880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5807:x1869199364395392:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 73us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607676.119135:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782607676.119175:0:5807:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1782607676.119180:0:5807:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:2.0:1782607676.119198:0:5807:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974551140a80, transno 4294967301 00000100:00100000:2.0:1782607676.119211:0:5807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f384380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5807:1869199364395392:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1782607676.119622:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1782607676.119670:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974541320000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5807:1869199364395520:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1782607676.119699:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607676.119716:0:5807:0:(client.c:2701:ptlrpc_set_wait()) set ffff97454c91e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782607676.119902:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364395520 00000100:00100000:2.0:1782607676.119907:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364395520 00000100:00100000:2.0:1782607676.119934:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782607676.119941:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974541321180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5807:x1869199364395520:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1782607676.120078:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974541321180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5807:x1869199364395520:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 136us (377us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1782607676.120085:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782607676.120119:0:5807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974541320000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5807:1869199364395520:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1782607676.120167:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1782607676.120197:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb887 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.120207:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb887 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.120214:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb887 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.120220:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42000 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607676.120225:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb887 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.120233:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb887 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.120246:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9745432c6600) 00010000:00010000:2.0:1782607676.120249:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1782607676.120253:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb887 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.120260:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb887 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782607676.120401:0:5807:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1782607676.120493:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1782607676.120505:0:5807:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 334966738735ns, next at 335966736079ns, rc = 0 00000001:00080000:2.0:1782607676.120511:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1782607676.120541:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9745432c6600) 00010000:00010000:2.0:1782607676.120544:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1782607676.120551:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb872 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe07 expref: 47 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607676.120642:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549b88050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+46:10508:x1869199342355968:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 10403us (10650us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1782607676.120649:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 26 00000020:00080000:2.0:1782607676.120653:0:5807:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:3.0:1782607676.121195:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782607676.125035:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607676.125171:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342356224 00000100:00100000:2.0:1782607676.125180:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342356224 00000100:00100000:2.0:1782607676.125249:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 100 00000100:00100000:2.0:1782607676.125261:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f387b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+46:10508:x1869199342356224:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1782607676.125292:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607676.125318:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cb88e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffe0e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.125398:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cb88e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe0e expref: 47 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.125414:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cb88e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe0e expref: 47 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.125434:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9745432c6d00) 00010000:00010000:2.0:1782607676.125437:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782607676.125461:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974540030600, rc 0) 00000100:00100000:2.0:1782607676.125527:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f387b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+47:10508:x1869199342356224:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 268us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607676.125534:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 100 00000100:00100000:3.0:1782607676.128510:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607676.128921:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342356480 00000100:00100000:2.0:1782607676.128930:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342356480 00000100:00100000:2.0:1782607676.128978:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 27 00000100:00100000:2.0:1782607676.128988:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f387800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+47:10508:x1869199342356480:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:2.0:1782607676.129247:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f387800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+48:10508:x1869199342356480:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 259us (742us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1782607676.129255:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 27 00000100:00100000:3.0:1782607676.226988:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607676.227197:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342356608 00000100:00100000:2.0:1782607676.227208:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342356608 00000100:00100000:2.0:1782607676.227271:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 101 00000100:00100000:2.0:1782607676.227281:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f384380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+48:10518:x1869199342356608:12345-192.168.202.4@tcp:34:lfs.0 00010000:00010000:2.0:1782607676.227379:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974540030000/0x8109266df35cb895 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.227398:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974540030000/0x8109266df35cb895 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.227413:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974540030000/0x8109266df35cb895 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.227432:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb89c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.227439:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb89c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.227468:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb89c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.227597:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb8a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.227617:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb8a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.227625:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb8a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782607676.227666:0:7437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb8a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.227679:0:7437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974540030000/0x8109266df35cb895 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.227685:0:7437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974540030000/0x8109266df35cb895 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.227692:0:7437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974540030000/0x8109266df35cb895 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.227698:0:7437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974540030000 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607676.227703:0:7437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974540030000/0x8109266df35cb895 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.227711:0:7437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974540030000/0x8109266df35cb895 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.227723:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97454c8e3300) 00010000:00010000:2.0:1782607676.227731:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607676.227736:0:7437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974540030000/0x8109266df35cb895 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.227743:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974540030000/0x8109266df35cb895 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.227757:0:7437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb89c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.227806:0:7437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb89c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.227814:0:7437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb89c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.227819:0:7437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ace00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607676.227821:0:7437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb89c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.227827:0:7437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb89c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.227835:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9745432c6600) 00010000:00010000:2.0:1782607676.227837:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607676.227840:0:7437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb89c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.227846:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb89c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.227869:0:7437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb8a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.227881:0:7437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb8a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.227887:0:7437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb8a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.227892:0:7437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ada00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607676.227894:0:7437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb8a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.227901:0:7437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb8a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.227909:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9745432c6d00) 00010000:00010000:2.0:1782607676.227911:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607676.227915:0:7437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb8a3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.227920:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cb8a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607676.228013:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f384380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+48:10518:x1869199342356608:12345-192.168.202.4@tcp:34:lfs.0 Request processed in 726us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607676.228022:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 101 00000100:00100000:2.0:1782607676.268941:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607676.269547:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342356864 00000100:00100000:3.0:1782607676.269561:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342356864 00000100:00100000:3.0:1782607676.269640:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 102 00000100:00100000:3.0:1782607676.269651:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974541322680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+48:10521:x1869199342356864:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1782607676.269673:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607676.269694:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cb8aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffe15 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607676.269800:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cb8b1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607676.269816:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cb8b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607676.269828:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cb8b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607676.269843:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648200/0x8109266df35cb8b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607676.269868:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648200/0x8109266df35cb8b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607676.269874:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648200/0x8109266df35cb8b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607676.270022:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cb8bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607676.270030:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cb8bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607676.270037:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cb8bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782607676.270048:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1782607676.270155:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cb8b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607676.270164:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cb8b1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607676.270171:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cb8b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607676.270177:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d649a00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:3.0:1782607676.270181:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cb8b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607676.270188:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cb8b1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607676.270211:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97454c8e3300) 00010000:00010000:3.0:1782607676.270214:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782607676.270220:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cb8b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607676.270227:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cb8b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607676.270241:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648200/0x8109266df35cb8b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607676.270247:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648200/0x8109266df35cb8b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607676.270252:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648200/0x8109266df35cb8b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607676.270257:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d648200 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:3.0:1782607676.270260:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648200/0x8109266df35cb8b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607676.270266:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648200/0x8109266df35cb8b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607676.270274:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9745454f5300) 00010000:00010000:3.0:1782607676.270276:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782607676.270279:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648200/0x8109266df35cb8b8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607676.270285:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648200/0x8109266df35cb8b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607676.270344:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cb8aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe15 expref: 51 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607676.270359:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cb8bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe15 expref: 50 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607676.270365:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9745432c6d00) 00010000:00010000:3.0:1782607676.270367:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782607676.270370:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97455d649200, rc 0) 00000100:00100000:3.0:1782607676.270444:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974541322680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+50:10521:x1869199342356864:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 795us (1513us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1782607676.270451:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 102 00000100:00100000:0.0:1782607676.276089:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607676.276238:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342356992 00000100:00100000:2.0:1782607676.276248:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342356992 00000100:00100000:2.0:1782607676.276310:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 103 00000100:00100000:2.0:1782607676.276321:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745799a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+50:10521:x1869199342356992:12345-192.168.202.4@tcp:54:lfs.0 00010000:00010000:2.0:1782607676.276417:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb8cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.276434:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb8cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.276446:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb8cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.276473:0:7437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb8cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.276479:0:7437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb8cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.276486:0:7437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb8cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.276491:0:7437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ace00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607676.276496:0:7437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb8cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.276502:0:7437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb8cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.276514:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9745432c6d00) 00010000:00010000:2.0:1782607676.276517:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782607676.276521:0:7437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb8cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.276527:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb8cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607676.276618:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745799a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+50:10521:x1869199342356992:12345-192.168.202.4@tcp:54:lfs.0 Request processed in 298us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607676.276625:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 103 00000100:00100000:2.0:1782607676.280000:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607676.280099:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342357248 00000100:00100000:1.0:1782607676.280108:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342357248 00000100:00100000:1.0:1782607676.280190:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 28 00000100:00100000:1.0:1782607676.280202:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974541321880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+50:10521:x1869199342357248:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:1.0:1782607676.280436:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974541321880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+51:10521:x1869199342357248:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 235us (444us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1782607676.280458:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 28 00000100:00100000:3.0:1782607676.423912:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607676.424298:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342357504 00000100:00100000:2.0:1782607676.424309:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342357504 00000100:00100000:2.0:1782607676.424391:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 104 00000100:00100000:2.0:1782607676.424402:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+51:10531:x1869199342357504:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:2.0:1782607676.424433:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607676.424436:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1782607676.424467:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb84f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdf9 expref: 51 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.424485:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97454c8e3300) 00010000:00010000:2.0:1782607676.424490:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782607676.424501:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb8d4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffe1c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.424601:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb8db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.424615:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb8db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.424625:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb8db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782607676.424636:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1782607676.424941:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb8d4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe1c expref: 53 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.424958:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb8db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe1c expref: 52 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.424965:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9745432c6d00) 00010000:00010000:2.0:1782607676.424968:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782607676.424971:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585acc00, rc 0) 00000100:00100000:2.0:1782607676.425326:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+52:10531:x1869199342357504:12345-192.168.202.4@tcp:101:bash.0 Request processed in 925us (1423us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1782607676.425334:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 104 00000100:00100000:0.0:1782607676.432521:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607676.432617:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342357632 00000100:00100000:3.0:1782607676.432628:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342357632 00000100:00100000:3.0:1782607676.432696:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7 00000100:00100000:3.0:1782607676.432706:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745799a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+52:2355:x1869199342357632:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782607676.432723:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782607676.432749:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb8db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe1c expref: 52 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607676.433238:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9745432c6d00) 00010000:00010000:3.0:1782607676.433244:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782607676.433305:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745799a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+51:2355:x1869199342357632:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 600us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607676.433313:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7 00000100:00100000:0.0:1782607676.441065:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607676.441285:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342357888 00000100:00100000:2.0:1782607676.441295:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342357888 00000100:00100000:2.0:1782607676.441366:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 105 00000100:00100000:2.0:1782607676.441376:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745799a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+51:10531:x1869199342357888:12345-192.168.202.4@tcp:36:bash.0 00010000:00010000:2.0:1782607676.441461:0:7437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782607676.441489:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cb8bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe15 expref: 51 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.441507:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9745432c6d00) 00010000:00010000:2.0:1782607676.441512:0:7437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782607676.441718:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb8e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.441734:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb8e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607676.441743:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb8e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782607676.442279:0:7437:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1782607676.442308:0:7437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005691d68a reply state 000000007f31a557 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb8e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607676.442316:0:7437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782607676.442649:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745799a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+53:10531:x1869199342357888:12345-192.168.202.4@tcp:36:bash.0 Request processed in 1272us (1592us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1782607676.442658:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 105 00000020:00080000:2.0:1782607676.442664:0:7437:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1782607676.447569:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb8e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607676.447589:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb8e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607676.447608:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb8e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607676.447615:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ace00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607676.447620:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb8e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607676.447629:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb8e9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607676.447648:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9745432c6d00) 00010000:00010000:0.0:1782607676.447667:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782607676.447673:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb8e9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607676.447680:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cb8e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607676.451667:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607676.451750:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342358016 00000100:00100000:1.0:1782607676.451762:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342358016 00000100:00100000:1.0:1782607676.451868:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 106 00000100:00100000:1.0:1782607676.451879:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745799a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+52:10531:x1869199342358016:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:1.0:1782607676.451908:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607676.451933:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466600/0x8109266df35cb8f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffe23 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.452173:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cb8f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.452190:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cb8f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.452203:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cb8f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782607676.452232:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1782607676.452236:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782607676.452253:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cb8f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.452277:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466600/0x8109266df35cb8f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe23 expref: 54 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.452293:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cb8f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe23 expref: 53 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.452320:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9745432c6d00) 00010000:00010000:1.0:1782607676.452323:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782607676.452326:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97457f466a00, rc 0) 00000100:00100000:1.0:1782607676.452383:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745799a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+53:10531:x1869199342358016:12345-192.168.202.4@tcp:101:bash.0 Request processed in 506us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607676.452389:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 106 00000100:00100000:2.0:1782607676.460743:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607676.460863:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342358272 00000100:00100000:1.0:1782607676.460873:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342358272 00000100:00100000:1.0:1782607676.460933:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 29 00000100:00100000:1.0:1782607676.460943:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974541322a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+53:10531:x1869199342358272:12345-192.168.202.4@tcp:35:bash.0 00000100:00100000:1.0:1782607676.461244:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974541322a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+54:10531:x1869199342358272:12345-192.168.202.4@tcp:35:bash.0 Request processed in 301us (514us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1782607676.461252:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 29 00000100:00100000:0.0:1782607676.567298:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607676.567402:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342358400 00000100:00100000:1.0:1782607676.567412:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342358400 00000100:00100000:1.0:1782607676.567478:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 107 00000100:00100000:1.0:1782607676.567489:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745799a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+54:10537:x1869199342358400:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1782607676.567515:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607676.567538:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466600/0x8109266df35cb8fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffe2a expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.567623:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cb905 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.567637:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cb905 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.567664:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cb905 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782607676.567724:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1782607676.567728:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1782607676.567745:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cb905 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.567786:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466600/0x8109266df35cb8fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe2a expref: 56 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.567803:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cb905 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe2a expref: 55 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.567813:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97454c8e3300) 00010000:00010000:1.0:1782607676.567815:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782607676.567819:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97457f467200, rc 0) 00000100:00100000:1.0:1782607676.567885:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745799a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+55:10537:x1869199342358400:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 398us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607676.567893:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 107 00000100:00100000:0.0:1782607676.572711:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607676.572790:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342358528 00000100:00100000:1.0:1782607676.572800:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342358528 00000100:00100000:1.0:1782607676.572860:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 108 00000100:00100000:1.0:1782607676.572867:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745799a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+55:10537:x1869199342358528:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1782607676.572885:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607676.572901:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466e00/0x8109266df35cb90c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffe31 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.572967:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cb913 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.572978:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cb913 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.572988:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cb913 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.573003:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467800/0x8109266df35cb91a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.573010:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467800/0x8109266df35cb91a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.573017:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467800/0x8109266df35cb91a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.573112:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb921 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.573131:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb921 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.573138:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb921 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782607676.573173:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1782607676.573177:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782607676.573196:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb921 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.573213:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb921 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.573219:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cb913 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.573223:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cb913 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.573228:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cb913 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.573231:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f467e00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607676.573234:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cb913 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.573238:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cb913 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.573247:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97454c8e3300) 00010000:00010000:1.0:1782607676.573249:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607676.573252:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cb913 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.573255:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cb913 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.573264:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467800/0x8109266df35cb91a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.573268:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467800/0x8109266df35cb91a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.573274:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467800/0x8109266df35cb91a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.573278:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f467800 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607676.573279:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467800/0x8109266df35cb91a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.573283:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467800/0x8109266df35cb91a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.573286:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff974543e77a00) 00010000:00010000:1.0:1782607676.573288:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607676.573289:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467800/0x8109266df35cb91a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.573292:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467800/0x8109266df35cb91a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.573313:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466e00/0x8109266df35cb90c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe31 expref: 57 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.573322:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb921 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe31 expref: 56 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.573325:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9745432c6d00) 00010000:00010000:1.0:1782607676.573327:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782607676.573328:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97457f467600, rc 0) 00000100:00100000:1.0:1782607676.573391:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745799a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+56:10537:x1869199342358528:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 523us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607676.573406:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 108 00000100:00100000:3.0:1782607676.578973:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607676.580438:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342358784 00000100:00100000:1.0:1782607676.580449:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342358784 00000100:00100000:1.0:1782607676.580509:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 109 00000100:00100000:1.0:1782607676.580518:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+56:10537:x1869199342358784:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1782607676.580536:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607676.580556:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466600/0x8109266df35cb928 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffe38 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.580662:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466200/0x8109266df35cb92f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.580675:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cb8f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe23 expref: 57 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.580683:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb921 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe31 expref: 57 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.580691:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466200/0x8109266df35cb92f lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.580721:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb921 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe31 expref: 57 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.580734:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb921 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe31 expref: 57 pid: 5803 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607676.580746:0:5805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f4b6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1869199364395648:192.168.202.4@tcp:104: 00010000:00010000:1.0:1782607676.580871:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cb8f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe23 expref: 57 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.580880:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cb8f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe23 expref: 57 pid: 5803 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607676.580889:0:5805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f4b5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1869199364395776:192.168.202.4@tcp:104: 00000100:00100000:1.0:1782607676.580908:0:5805:0:(client.c:2701:ptlrpc_set_wait()) set ffff97456a83f480 going to sleep for 11 seconds 00000100:00100000:0.0:1782607676.586098:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607676.586236:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342358912 00000100:00100000:3.0:1782607676.586247:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342358912 00010000:00010000:3.0:1782607676.586289:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb921 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe31 expref: 58 pid: 5803 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607676.586336:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 52 00000100:00100000:3.0:1782607676.586348:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745799a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+58:2356:x1869199342358912:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782607676.586365:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782607676.586372:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb921 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe31 expref: 58 pid: 5803 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607676.586385:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb921 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe31 expref: 58 pid: 5803 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607676.586408:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9745432c6d00) 00010000:00010000:3.0:1782607676.586412:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466200/0x8109266df35cb92f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607676.586421:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466200/0x8109266df35cb92f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607676.586426:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782607676.586487:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745799a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+58:2356:x1869199342358912:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 141us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607676.586495:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 52 00000100:00100000:0.0:1782607676.594841:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:1.0:1782607676.596284:0:5805:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.4@tcp) returned -22 from blocking AST (req@000000006bbfe77c x1869199364395648) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb921 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe31 expref: 57 pid: 5803 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.596313:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb921 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe31 expref: 57 pid: 5803 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607676.596332:0:5805:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f4b6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1869199364395648:192.168.202.4@tcp:104: 00000100:00100000:1.0:1782607676.596345:0:5805:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f4b5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1869199364395776:192.168.202.4@tcp:104: 00010000:00010000:1.0:1782607676.596366:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9745432c6d00) 00010000:00010000:1.0:1782607676.596371:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466200/0x8109266df35cb92f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.596380:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466200/0x8109266df35cb92f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.596388:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466200/0x8109266df35cb92f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607676.599589:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342359040 00000100:00100000:3.0:1782607676.599606:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342359040 00010000:00010000:3.0:1782607676.599670:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cb8f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe23 expref: 57 pid: 5803 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607676.599728:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 53 00000100:00100000:3.0:1782607676.599737:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745799a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+57:2357:x1869199342359040:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782607676.599752:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782607676.599759:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cb8f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe23 expref: 57 pid: 5803 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607676.599800:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cb8f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe23 expref: 57 pid: 5803 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607676.599823:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cb8f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe23 expref: 57 pid: 5803 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607676.599840:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9745432c6d00) 00010000:00010000:3.0:1782607676.599845:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466200/0x8109266df35cb92f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607676.599856:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466200/0x8109266df35cb92f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607676.599865:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466200/0x8109266df35cb92f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607676.599893:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782607676.599971:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745799a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+56:2357:x1869199342359040:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 235us (5141us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607676.599980:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 53 00010000:00010000:1.0:1782607676.600299:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466200/0x8109266df35cb92f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.600317:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466200/0x8109266df35cb92f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782607676.600339:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1782607676.600503:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466600/0x8109266df35cb928 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe38 expref: 57 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.600519:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466200/0x8109266df35cb92f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe38 expref: 56 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.600526:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9745432c6d00) 00010000:00010000:1.0:1782607676.600530:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782607676.600532:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97457f466200, rc 0) 00000100:00100000:1.0:1782607676.600564:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+56:10537:x1869199342358784:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 20047us (21602us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1782607676.600571:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 109 00010000:00010000:0.0:1782607676.609957:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782607676.613733:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607676.613849:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342359296 00000100:00100000:1.0:1782607676.613859:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342359296 00000100:00100000:1.0:1782607676.613927:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8 00000100:00100000:1.0:1782607676.613939:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974548804050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+56:10537:x1869199342359296:12345-192.168.202.4@tcp:103:lfs.0 00010000:00010000:1.0:1782607676.613959:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782607676.613984:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cb88e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe0e expref: 56 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.614004:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9745432c6d00) 00010000:00010000:1.0:1782607676.614009:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782607676.614080:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974548804050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+55:10537:x1869199342359296:12345-192.168.202.4@tcp:103:lfs.0 Request processed in 142us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607676.614088:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8 00000100:00100000:2.0:1782607676.617161:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607676.617300:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342359424 00000100:00100000:1.0:1782607676.617310:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342359424 00000100:00100000:1.0:1782607676.617362:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 110 00000100:00100000:1.0:1782607676.617372:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974541323100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+55:10537:x1869199342359424:12345-192.168.202.4@tcp:58:lfs.0 00010000:00010000:1.0:1782607676.617506:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466600/0x8109266df35cb93d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.617523:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466600/0x8109266df35cb93d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607676.617531:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466600/0x8109266df35cb93d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782607676.617826:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1782607676.617920:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974541323100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+55:10537:x1869199342359424:12345-192.168.202.4@tcp:58:lfs.0 Request processed in 549us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607676.617929:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 110 00000100:00100000:2.0:1782607676.625651:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607676.625809:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342359552 00000100:00100000:0.0:1782607676.625819:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342359552 00000100:00100000:0.0:1782607676.625875:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 111 00000100:00100000:0.0:1782607676.625886:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974541322300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+55:10537:x1869199342359552:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1782607676.625905:0:7437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607676.625922:0:7437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42e00/0x8109266df35cb944 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffe3f expref: -99 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607676.625975:0:7437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466600/0x8109266df35cb93d lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607676.625987:0:7437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42e00/0x8109266df35cb944 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe3f expref: 56 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607676.626005:0:7437:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466600/0x8109266df35cb93d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607676.626036:0:7437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42e00/0x8109266df35cb944 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe3f expref: 56 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607676.626050:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9745432c6d00) 00010000:00010000:0.0:1782607676.626053:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782607676.626057:0:7437:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42e00/0x8109266df35cb944 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe3f expref: 56 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607676.626065:0:7437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c42e00, rc 0) 00000100:00100000:0.0:1782607676.626279:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974541322300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+56:10537:x1869199342359552:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 395us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607676.626285:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 111 00000100:00100000:0.0:1782607676.651447:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607676.651530:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607676.651566:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607676.651596:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607676.651669:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342360064 00000100:00100000:1.0:1782607676.651669:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342359808 00000100:00100000:1.0:1782607676.651679:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342359808 00000100:00100000:3.0:1782607676.651684:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342360064 00000100:00100000:1.0:1782607676.651726:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342359936 00000100:00100000:1.0:1782607676.651730:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342359936 00000100:00100000:1.0:1782607676.651753:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 81 00000100:00100000:1.0:1782607676.651762:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745799a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+8:2357:x1869199342359808:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1782607676.651789:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 143 00000100:00100000:3.0:1782607676.651796:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745799a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2357:x1869199342360064:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1782607676.651854:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745799a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+8:2357:x1869199342359808:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 93us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607676.651862:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 81 00000100:00100000:1.0:1782607676.651885:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 82 00000100:00080000:0.0:1782607676.651886:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782607676.651891:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745799a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:2357:x1869199342359936:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1782607676.651917:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745799a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:2357:x1869199342359936:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 26us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607676.651923:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 82 00000100:00100000:3.0:1782607676.651984:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745799a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2357:x1869199342360064:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 188us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607676.651991:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 143 00000100:00100000:2.0:1782607676.653288:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342359680 00000100:00100000:2.0:1782607676.653297:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342359680 00000100:00100000:2.0:1782607676.655837:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 290 00000100:00100000:2.0:1782607676.655860:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2356:x1869199342359680:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607676.655944:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2356:x1869199342359680:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 94us (4507us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607676.655949:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 290 00000040:00080000:0.0:1782607677.187272:0:11563:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782607677.187282:0:11563:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782607677.187341:0:11563:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1782607677.187347:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782607677.187451:0:11563:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457ff1ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11563:1869199364395904:192.168.202.4@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1782607677.187665:0:11563:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745510dd480 going to sleep for 11 seconds 00000100:00100000:0.0:1782607677.198841:0:11563:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457ff1ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11563:1869199364395904:192.168.202.4@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1782607677.203888:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607677.204208:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342360192 00000100:00100000:1.0:1782607677.204226:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342360192 00000100:00100000:1.0:1782607677.204311:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 112 00000100:00100000:1.0:1782607677.204322:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974541321c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+56:10538:x1869199342360192:12345-192.168.202.4@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1782607677.204352:0:5805:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1782607677.204446:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974541321c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+56:10538:x1869199342360192:12345-192.168.202.4@tcp:53:lhsmtool_posix.0 Request processed in 125us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607677.204453:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 112 00000100:00080000:0.0:1782607677.206083:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782607677.220894:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607677.221017:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342360320 00000100:00100000:0.0:1782607677.221041:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342360320 00000100:00100000:0.0:1782607677.221107:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 113 00000100:00100000:0.0:1782607677.221128:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+56:10538:x1869199342360320:12345-192.168.202.4@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1782607677.221204:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb94b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.221233:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb94b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.221248:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb94b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.221273:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb952 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.221281:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb952 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.221288:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb952 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.221312:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cb959 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.221321:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cb959 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.221328:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cb959 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782607677.221365:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1782607677.221370:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782607677.221389:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cb959 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.221401:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb94b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.221407:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb94b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.221413:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb94b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.221418:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42c00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607677.221422:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb94b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.221429:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb94b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.221440:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97454c8e3f00) 00010000:00010000:0.0:1782607677.221443:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782607677.221447:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb94b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.221453:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb94b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.221466:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb952 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.221472:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb952 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.221478:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb952 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.221490:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42000 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607677.221493:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb952 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.221498:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb952 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.221506:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff97454c8e3500) 00010000:00010000:0.0:1782607677.221509:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782607677.221511:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb952 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.221517:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb952 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.221534:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cb959 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.221541:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cb959 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.221546:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cb959 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.221551:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42a00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607677.221554:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cb959 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.221561:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cb959 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.221580:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9745432c6d00) 00010000:00010000:0.0:1782607677.221582:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782607677.221585:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cb959 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.221592:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cb959 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607677.221670:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+56:10538:x1869199342360320:12345-192.168.202.4@tcp:34:lhsmtool_posix.0 Request processed in 544us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607677.221679:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 113 00000100:00100000:3.0:1782607677.228879:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607677.228972:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342360576 00000100:00100000:1.0:1782607677.228981:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342360576 00000100:00100000:1.0:1782607677.229048:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 114 00000100:00100000:1.0:1782607677.229058:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+56:10538:x1869199342360576:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782607677.229077:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607677.229105:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb960 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffe46 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.229210:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466e00/0x8109266df35cb967 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.229233:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466e00/0x8109266df35cb967 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.229260:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466e00/0x8109266df35cb967 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782607677.229278:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1782607677.229373:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466e00/0x8109266df35cb967 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.229381:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466e00/0x8109266df35cb967 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.229387:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466e00/0x8109266df35cb967 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.229393:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f466e00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607677.229397:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466e00/0x8109266df35cb967 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.229404:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466e00/0x8109266df35cb967 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.229417:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9745432c6d00) 00010000:00010000:1.0:1782607677.229419:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782607677.229424:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466e00/0x8109266df35cb967 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.229429:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466e00/0x8109266df35cb967 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.229468:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb960 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe46 expref: 58 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.229489:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97454c8e3f00) 00010000:00010000:1.0:1782607677.229491:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782607677.229496:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb960 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe46 expref: 58 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.229505:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97457f467600, rc 0) 00000100:00100000:1.0:1782607677.229565:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+57:10538:x1869199342360576:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 Request processed in 509us (710us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1782607677.229572:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 114 00000100:00100000:2.0:1782607677.233622:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607677.233705:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342360704 00000100:00100000:0.0:1782607677.233714:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342360704 00000100:00100000:0.0:1782607677.233803:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 115 00000100:00100000:0.0:1782607677.233813:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974541321f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+57:10538:x1869199342360704:12345-192.168.202.4@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782607677.233845:0:5803:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782607677.233926:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974541321f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+57:10538:x1869199342360704:12345-192.168.202.4@tcp:53:lhsmtool_posix.0 Request processed in 115us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607677.233933:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 115 00000100:00100000:3.0:1782607677.242688:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607677.242858:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342360960 00000100:00100000:1.0:1782607677.242869:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342360960 00000100:00100000:1.0:1782607677.242920:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 116 00000100:00100000:1.0:1782607677.242930:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745509ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+57:10538:x1869199342360960:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782607677.242948:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607677.242951:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1782607677.242977:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cb905 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe2a expref: 57 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.243004:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97454c8e3300) 00010000:00010000:1.0:1782607677.243008:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782607677.243019:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb975 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffe4d expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782607677.243448:0:5805:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1782607677.243641:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466e00/0x8109266df35cb97c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.243665:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466e00/0x8109266df35cb97c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.243675:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466e00/0x8109266df35cb97c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.243728:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb975 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe4d expref: 59 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.243741:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466e00/0x8109266df35cb97c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe4d expref: 58 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.243748:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff974543e77a00) 00010000:00010000:1.0:1782607677.243751:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782607677.243754:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97457f466e00, rc 0) 00000100:00100000:1.0:1782607677.244200:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745509ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+58:10538:x1869199342360960:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 Request processed in 1270us (1520us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1782607677.244207:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 116 00000100:00100000:2.0:1782607677.270055:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607677.270250:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342361216 00000100:00100000:0.0:1782607677.270260:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342361216 00000100:00100000:0.0:1782607677.270319:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 117 00000100:00100000:0.0:1782607677.270329:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974541323b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+58:10538:x1869199342361216:12345-192.168.202.4@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1782607677.270386:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782607677.270412:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466e00/0x8109266df35cb97c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe4d expref: 58 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.270452:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff974543e77a00) 00010000:00010000:0.0:1782607677.270463:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782607677.270483:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb98a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.270497:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb98a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.270506:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb98a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.270520:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb991 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x7bd5239b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.270528:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb991 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7bd5239b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.270534:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb991 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7bd5239b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.270618:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb98a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.270626:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb98a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.270634:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb98a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.270640:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42000 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607677.270645:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb98a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.270659:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb98a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.270668:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97454c8e3300) 00010000:00010000:0.0:1782607677.270671:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782607677.270675:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb98a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.270681:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb98a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.270690:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb991 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7bd5239b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.270696:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb991 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7bd5239b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.270702:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb991 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7bd5239b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.270708:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42c00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607677.270710:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb991 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7bd5239b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.270716:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb991 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7bd5239b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.270724:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x7bd5239b (ffff97454c8e3500) 00010000:00010000:0.0:1782607677.270726:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782607677.270729:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb991 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x7bd5239b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.270746:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cb991 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x7bd5239b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607677.271273:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974541323b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+57:10538:x1869199342361216:12345-192.168.202.4@tcp:36:lhsmtool_posix.0 Request processed in 944us (1226us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782607677.271281:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 117 00000100:00100000:0.0:1782607677.291501:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607677.291610:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342361344 00000100:00100000:1.0:1782607677.291620:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342361344 00000100:00100000:1.0:1782607677.291678:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 118 00000100:00100000:1.0:1782607677.291689:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457ff1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+57:10538:x1869199342361344:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782607677.291709:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607677.291731:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb998 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffe54 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.291809:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cb99f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.291838:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cb99f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.291851:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cb99f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.291964:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb998 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe54 expref: 59 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.291983:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cb99f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe54 expref: 58 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.291992:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff974543e77100) 00010000:00010000:1.0:1782607677.291995:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782607677.291998:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97457f467200, rc 0) 00000100:00100000:1.0:1782607677.292053:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457ff1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+58:10538:x1869199342361344:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 Request processed in 366us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607677.292059:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 118 00000100:00100000:2.0:1782607677.300473:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607677.300722:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342361600 00000100:00100000:0.0:1782607677.300732:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342361600 00000100:00100000:0.0:1782607677.300829:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 119 00000100:00100000:0.0:1782607677.300840:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974541321500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+58:10538:x1869199342361600:12345-192.168.202.4@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1782607677.300929:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb9a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.300948:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb9a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.300960:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb9a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782607677.301368:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:0.0:1782607677.301377:0:5803:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 336147610990ns, next at 337147608981ns, rc = 0 00000004:00010000:0.0:1782607677.301457:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000085385c21 reply state 0000000089daf15f transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb9a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607677.301467:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782607677.301567:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974541321500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+60:10538:x1869199342361600:12345-192.168.202.4@tcp:36:lhsmtool_posix.0 Request processed in 728us (1102us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1782607677.301592:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 119 00010000:00010000:1.0:1782607677.310201:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb9a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.310220:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb9a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.310228:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb9a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.310235:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42000 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607677.310239:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb9a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.310263:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb9a6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.310795:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff974543e77100) 00010000:00010000:1.0:1782607677.310799:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782607677.310804:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb9a6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.310811:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cb9a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607677.318995:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607677.319097:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342361728 00000100:00100000:1.0:1782607677.319108:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342361728 00000100:00100000:1.0:1782607677.319176:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 120 00000100:00100000:1.0:1782607677.319186:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974541320e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+59:10538:x1869199342361728:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782607677.319209:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607677.319228:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb9ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffe5b expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.319285:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb9ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe5b expref: 60 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.319300:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb9ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe5b expref: 60 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.319334:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff974543e77100) 00010000:00010000:1.0:1782607677.319338:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782607677.319342:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97457f467600, rc 0) 00000100:00100000:1.0:1782607677.319426:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974541320e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+60:10538:x1869199342361728:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 Request processed in 241us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607677.319433:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 120 00000100:00100000:2.0:1782607677.330541:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607677.330636:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342361856 00000100:00100000:0.0:1782607677.330645:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342361856 00000100:00100000:0.0:1782607677.330719:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 37 00000100:00100000:0.0:1782607677.330729:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974541322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+8:2356:x1869199342361856:12345-192.168.202.4@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1782607677.331063:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974541322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+9:2356:x1869199342361856:12345-192.168.202.4@tcp:2:lhsmtool_posix.0 Request processed in 335us (531us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1782607677.331071:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 37 00000100:00080000:3.0:1782607677.331388:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782607677.334576:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607677.335982:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342362112 00000100:00100000:1.0:1782607677.335994:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342362112 00000100:00100000:2.0:1782607677.336151:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 30 00000100:00100000:2.0:1782607677.336163:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745509edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+60:10538:x1869199342362112:12345-192.168.202.4@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1782607677.336494:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745509edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+61:10538:x1869199342362112:12345-192.168.202.4@tcp:35:lhsmtool_posix.0 Request processed in 332us (1926us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1782607677.336503:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 30 00000100:00100000:2.0:1782607677.344427:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607677.344532:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342362368 00000100:00100000:3.0:1782607677.344542:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342362368 00000100:00100000:3.0:1782607677.344606:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 121 00000100:00100000:3.0:1782607677.344617:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f46d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+61:10538:x1869199342362368:12345-192.168.202.4@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1782607677.344739:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f46d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+61:10538:x1869199342362368:12345-192.168.202.4@tcp:57:lhsmtool_posix.0 Request processed in 122us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607677.344746:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 121 00000100:00100000:3.0:1782607677.362198:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607677.362291:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342362496 00000100:00100000:1.0:1782607677.362301:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342362496 00000100:00100000:1.0:1782607677.362447:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 122 00000100:00100000:1.0:1782607677.362458:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+61:10538:x1869199342362496:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782607677.362480:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607677.362500:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467800/0x8109266df35cb9b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffe62 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.362586:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cb9bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.362600:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cb9bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.362610:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cb9bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782607677.362644:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782607677.362661:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cb9bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.362684:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467800/0x8109266df35cb9b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe62 expref: 63 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.362701:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cb9bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe62 expref: 62 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.362716:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff974543e77100) 00010000:00010000:1.0:1782607677.362719:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1782607677.362723:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97457f467e00, rc 0) 00000100:00100000:1.0:1782607677.362822:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+62:10538:x1869199342362496:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 Request processed in 365us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607677.362829:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 122 00000100:00100000:2.0:1782607677.367549:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607677.370962:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342362624 00000100:00100000:1.0:1782607677.370976:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342362624 00000100:00100000:1.0:1782607677.371037:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 38 00000100:00100000:1.0:1782607677.371048:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f46d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+9:2357:x1869199342362624:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782607677.371067:0:6610:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607677.371089:0:6610:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2c31efd/0x8109266df35cb9c2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffe69 expref: -99 pid: 6610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782607677.371131:0:6610:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a406f3e, blocks: 0x1 00010000:00010000:1.0:1782607677.371151:0:6610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=336s v=(0 0) 00010000:00010000:1.0:1782607677.371156:0:6610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607677.371166:0:6610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2c31efd/0x8109266df35cb9c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe69 expref: 10 pid: 6610 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.371186:0:6610:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d2c31efd/0x8109266df35cb9c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe69 expref: 10 pid: 6610 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.371200:0:6610:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97457f467800, rc 0) 00000100:00100000:1.0:1782607677.371271:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f46d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+10:2357:x1869199342362624:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 Request processed in 225us (3730us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607677.371290:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 38 00000100:00100000:3.0:1782607677.374647:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607677.375517:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342362880 00000100:00100000:2.0:1782607677.375528:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342362880 00000100:00100000:2.0:1782607677.375605:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 123 00000100:00100000:2.0:1782607677.375621:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+62:10538:x1869199342362880:12345-192.168.202.4@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1782607677.375757:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+62:10538:x1869199342362880:12345-192.168.202.4@tcp:57:lhsmtool_posix.0 Request processed in 143us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607677.375994:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 123 00000100:00100000:3.0:1782607677.379689:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607677.379810:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342363008 00000100:00100000:0.0:1782607677.379820:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342363008 00000100:00100000:0.0:1782607677.379891:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 39 00000100:00100000:0.0:1782607677.379900:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+10:10538:x1869199342363008:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782607677.379921:0:6608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607677.379944:0:6608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000240a769d/0x8109266df35cb9c9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffe70 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.379980:0:6608:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d2c31efd/0x8109266df35cb9c2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe69 expref: 11 pid: 6610 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.379989:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607677.379993:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607677.380010:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000240a769d/0x8109266df35cb9c9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe70 expref: 11 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.380046:0:6608:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d2c31efd/0x8109266df35cb9c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe69 expref: 11 pid: 6610 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.380077:0:6608:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d2c31efd/0x8109266df35cb9c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe69 expref: 11 pid: 6610 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607677.380097:0:6608:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457ff1f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6608:1869199364396032:192.168.202.4@tcp:104: 00000100:00100000:0.0:1782607677.380212:0:6608:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745510dd600 going to sleep for 11 seconds 00000100:00100000:3.0:1782607677.389757:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607677.389939:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342363136 00000100:00100000:1.0:1782607677.389950:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342363136 00010000:00010000:1.0:1782607677.390013:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d2c31efd/0x8109266df35cb9c2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe69 expref: 12 pid: 6610 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607677.390062:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 54 00000100:00100000:1.0:1782607677.390072:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581009500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+12:2357:x1869199342363136:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782607677.390095:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782607677.390129:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d2c31efd/0x8109266df35cb9c2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe69 expref: 12 pid: 6610 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.390143:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d2c31efd/0x8109266df35cb9c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe69 expref: 12 pid: 6610 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.390175:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607677.390180:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607677.390187:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000240a769d/0x8109266df35cb9c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe70 expref: 12 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.390203:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000240a769d/0x8109266df35cb9c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe70 expref: 12 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.390245:0:5789:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000240a769d/0x8109266df35cb9c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe70 expref: 12 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607677.390279:0:5789:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f4b5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5789:1869199364396160:192.168.202.4@tcp:105: 00000100:00100000:1.0:1782607677.390495:0:5789:0:(client.c:2701:ptlrpc_set_wait()) set ffff97456a83f3c0 going to sleep for 11 seconds 00010000:00010000:0.0:1782607677.391248:0:6608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2c31efd/0x8109266df35cb9c2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe69 expref: 12 pid: 6610 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607677.391265:0:6608:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457ff1f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6608:1869199364396032:192.168.202.4@tcp:104: 00010000:00010000:0.0:1782607677.391288:0:6608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000240a769d/0x8109266df35cb9c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe70 expref: 11 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.391300:0:6608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c43800, rc 0) 00000100:00100000:0.0:1782607677.391550:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+11:10538:x1869199342363008:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 Request processed in 11649us (11877us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607677.391559:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 39 00000100:00100000:1.0:1782607677.395721:0:5789:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f4b5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5789:1869199364396160:192.168.202.4@tcp:105: 00010000:00010000:1.0:1782607677.395748:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782607677.395838:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581009500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+10:2357:x1869199342363136:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 5765us (6090us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607677.395849:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 54 00000100:00100000:2.0:1782607677.405874:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607677.407495:0:6614:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342363264 00000100:00100000:0.0:1782607677.407511:0:6614:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342363264 00002000:00100000:0.0:1782607677.407575:0:6614:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff97457f46c380 x1869199342363264/t0(0) o4->d72d7fb9-639f-4ad9-b658-df715cbf7792@192.168.202.4@tcp:593/0 lens 504/0 e 0 to 0 dl 1782607688 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782607677.407588:0:6614:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97457f46c380 with x1869199342363264 ext(0->12) 00002000:00010000:0.0:1782607677.407595:0:6614:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97457f46c380 00000100:00100000:0.0:1782607677.407638:0:6614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2 00000100:00100000:0.0:1782607677.407664:0:6614:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f46c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+10:2357:x1869199342363264:12345-192.168.202.4@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1782607677.408174:0:6614:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f46c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+12:2357:x1869199342363264:12345-192.168.202.4@tcp:4:lhsmtool_posix.0 Request processed in 511us (2310us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1782607677.408182:0:6614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2 00002000:00100000:0.0:1782607677.408190:0:6614:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff97457f46c380 x1869199342363264/t4294967308(0) o4->d72d7fb9-639f-4ad9-b658-df715cbf7792@192.168.202.4@tcp:593/0 lens 504/448 e 0 to 0 dl 1782607688 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782607677.408198:0:6614:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97457f46c380 with x1869199342363264 ext(0->12) 00002000:00010000:0.0:1782607677.408201:0:6614:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97457f46c380 00000100:00100000:3.0:1782607677.414280:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607677.414391:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342363392 00000100:00100000:2.0:1782607677.414402:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342363392 00000100:00100000:2.0:1782607677.414463:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 124 00000100:00100000:2.0:1782607677.414473:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458100b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+62:10538:x1869199342363392:12345-192.168.202.4@tcp:44:lhsmtool_posix.0 00000004:00080000:1.0:1782607677.507255:0:7892:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 336353487064ns, next at 337353484991ns, rc = 0 00000100:00100000:1.0:1782607677.507280:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782607677.507301:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f4b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364396288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782607677.507378:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607677.507452:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364396288 00000100:00100000:1.0:1782607677.507460:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364396288 00000100:00100000:1.0:1782607677.507509:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1782607677.507518:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1869199364396288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782607677.507549:0:6612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782607677.507588:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1869199364396288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607677.507595:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1782607677.507640:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f4b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364396288:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1782607677.516733:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:2.0:1782607677.516747:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:2.0:1782607677.516869:0:5825:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff974541376900 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1782607677.516875:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9745476da000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff974541376780 00000020:00080000:2.0:1782607677.516879:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9745476da300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9745812e7c00 00000001:00080000:2.0:1782607677.516898:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:2.0:1782607677.516915:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1782607677.516936:0:5825:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9745486eb000 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1782607677.516952:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff974571096200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9745486eb240 00000020:00080000:2.0:1782607677.516956:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff974571096700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97457f3a9800 00000020:00080000:2.0:1782607677.516976:0:5825:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:2.0:1782607677.516989:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000100:00100000:2.0:1782607677.517246:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458100b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+15:10538:x1869199342363392:12345-192.168.202.4@tcp:44:lhsmtool_posix.0 Request processed in 102770us (102971us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607677.517255:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 124 00000020:00080000:0.0:1782607677.517557:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1782607677.517798:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1782607677.518237:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782607677.518253:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f4b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364396416:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782607677.518304:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607677.519095:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364396416 00000100:00100000:1.0:1782607677.519106:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364396416 00000100:00100000:1.0:1782607677.519171:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782607677.519181:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f46c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3318:x1869199364396416:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782607677.519221:0:6610:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:1.0:1782607677.519257:0:6610:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a406f3c, atime: 0x6a406f3d, ctime: 0x6a406f3c, blocks: 0x1 00010000:00010000:1.0:1782607677.519266:0:6610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2c31efd/0x8109266df35cb9d0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.519284:0:6610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=336s v=(0 0) 00010000:00010000:1.0:1782607677.519288:0:6610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607677.519295:0:6610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2c31efd/0x8109266df35cb9d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.519309:0:6610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2c31efd/0x8109266df35cb9d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.519321:0:6610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2c31efd/0x8109266df35cb9d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.519329:0:6610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2c31efd/0x8109266df35cb9d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.519355:0:6610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782607677.519924:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f46c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3318:x1869199364396416:12345-0@lo:6:osp-syn-1-0.0 Request processed in 743us (1618us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1782607677.519934:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:1.0:1782607677.519988:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97457f4b5880/2, rc 0, transno 4294967304 00000100:00100000:1.0:1782607677.519995:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f4b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364396416:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782607677.520431:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581008700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364396672:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1782607677.520469:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607677.520502:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782607677.520507:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581009180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364396544:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782607677.520537:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607677.520566:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364396672 00000100:00100000:3.0:1782607677.520571:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364396672 00000100:00100000:3.0:1782607677.521299:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364396544 00000100:00100000:3.0:1782607677.521305:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364396544 00000100:00100000:3.0:1782607677.521326:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782607677.521334:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3317:x1869199364396672:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1782607677.521481:0:6608:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1782607677.521485:0:6608:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1782607678 00002000:00010000:3.0:1782607677.521487:0:6608:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1782607677.521489:0:6608:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1782607678 -> 1782607678 00002000:00010000:3.0:1782607677.521491:0:6608:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1782607677.521535:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3317:x1869199364396672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 201us (1065us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1782607677.521541:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782607677.521558:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1782607677.521564:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580c04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3317:x1869199364396544:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1782607677.521577:0:6608:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:2.0:1782607677.522211:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782607677.522221:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2c31efd/0x8109266df35cb9d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607677.522234:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f467800 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:2.0:1782607677.522240:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2c31efd/0x8109266df35cb9d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607677.522250:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2c31efd/0x8109266df35cb9d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607677.522272:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2c31efd/0x8109266df35cb9d0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607677.522279:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2c31efd/0x8109266df35cb9d0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607677.522322:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607677.522325:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607677.522327:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782607677.522381:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607677.522514:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342363520 00000100:00100000:1.0:1782607677.522526:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342363520 00000100:00100000:1.0:1782607677.522554:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 43 00000100:00100000:1.0:1782607677.522562:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f46f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+12:2356:x1869199342363520:12345-192.168.202.4@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1782607677.522689:0:6608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b7c6f56/0x8109266df35cb9d7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.522707:0:6608:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000091ce994d/0x8109266df35cb792 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdcf expref: 12 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.522715:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1782607677.522720:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782607677.522725:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b7c6f56/0x8109266df35cb9d7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.522981:0:6608:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000091ce994d/0x8109266df35cb792 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdcf expref: 12 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.523009:0:6608:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000091ce994d/0x8109266df35cb792 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdcf expref: 12 pid: 6608 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607677.523022:0:6608:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974551140a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6608:1869199364396800:192.168.202.4@tcp:104: 00000100:00100000:3.0:1782607677.523101:0:6608:0:(client.c:2701:ptlrpc_set_wait()) set ffff974544ccbc00 going to sleep for 11 seconds 00000100:00080000:2.0:1782607677.529408:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1782607677.529469:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff974581008700/2, rc 0, transno 4294967309 00000100:00100000:2.0:1782607677.529481:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581008700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364396672:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1782607677.553211:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607677.553343:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342363648 00000100:00100000:1.0:1782607677.553353:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342363648 00010000:00010000:1.0:1782607677.553394:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000091ce994d/0x8109266df35cb792 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdcf expref: 13 pid: 6608 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607677.553438:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 55 00000100:00100000:1.0:1782607677.553449:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974548948000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+13:2356:x1869199342363648:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782607677.553467:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782607677.553473:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000091ce994d/0x8109266df35cb792 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdcf expref: 13 pid: 6608 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.553487:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000091ce994d/0x8109266df35cb792 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdcf expref: 13 pid: 6608 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.553515:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782607677.553519:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782607677.553526:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006b7c6f56/0x8109266df35cb9d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.553536:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b7c6f56/0x8109266df35cb9d7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.553556:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782607677.553622:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974548948000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+13:2356:x1869199342363648:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 176us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607677.553630:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 55 00010000:00010000:3.0:1782607677.554022:0:6608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091ce994d/0x8109266df35cb792 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdcf expref: 12 pid: 6608 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607677.554040:0:6608:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974551140a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6608:1869199364396800:192.168.202.4@tcp:104: 00010000:00010000:3.0:1782607677.554062:0:6608:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006b7c6f56/0x8109266df35cb9d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.554072:0:6608:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006b7c6f56/0x8109266df35cb9d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.554080:0:6608:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b7c6f56/0x8109266df35cb9d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.554101:0:6608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b7c6f56/0x8109266df35cb9d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.554134:0:6608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b7c6f56/0x8109266df35cb9d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.554161:0:6608:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782607677.554716:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580c04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3317:x1869199364396544:12345-0@lo:6:osp-syn-0-0.0 Request processed in 33149us (34174us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1782607677.554724:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:1.0:1782607677.554876:0:7513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782607677.554883:0:7513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b7c6f56/0x8109266df35cb9d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.554892:0:7513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d648200 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:1.0:1782607677.554896:0:7513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b7c6f56/0x8109266df35cb9d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.554906:0:7513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b7c6f56/0x8109266df35cb9d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.554925:0:7513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b7c6f56/0x8109266df35cb9d7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.554932:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b7c6f56/0x8109266df35cb9d7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.554950:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607677.554953:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607677.554954:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782607677.555388:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff974581009180/2, rc 0, transno 4294967310 00000100:00100000:2.0:1782607677.555395:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581009180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364396544:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1782607677.612565:0:6634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:0.0:1782607677.612618:0:6634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:2.0:1782607677.612813:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f46f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2356:x1869199342363520:12345-192.168.202.4@tcp:16:lhsmtool_posix.0 Request processed in 90246us (90429us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607677.612826:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 43 00000100:00100000:2.0:1782607677.627031:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607677.627154:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342363904 00000100:00100000:0.0:1782607677.627166:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342363904 00000100:00100000:0.0:1782607677.627229:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 125 00000100:00100000:0.0:1782607677.627240:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458153b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+15:10538:x1869199342363904:12345-192.168.202.4@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1782607677.627300:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782607677.627431:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cb9bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe62 expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.627454:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff974543e77100) 00010000:00010000:0.0:1782607677.627459:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782607677.627497:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cb9de lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.627512:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cb9de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.627536:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cb9de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782607677.636369:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dabfeab1 reply state 0000000079558f96 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cb9de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607677.636389:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782607677.636522:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458153b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+16:10538:x1869199342363904:12345-192.168.202.4@tcp:36:lhsmtool_posix.0 Request processed in 9280us (9497us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1782607677.636532:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 125 00010000:00010000:0.0:1782607677.637413:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607677.645386:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cb9de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.645404:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cb9de lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.645429:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cb9de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.645435:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42600 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607677.645440:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cb9de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.645448:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cb9de lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.645466:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff974543e77100) 00010000:00010000:1.0:1782607677.645469:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607677.645473:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cb9de lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.645479:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cb9de lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607677.647172:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607677.647269:0:9088:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342364032 00000100:00100000:0.0:1782607677.647279:0:9088:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342364032 00000100:00100000:0.0:1782607677.647349:0:9088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 44 00000100:00100000:0.0:1782607677.647359:0:9088:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457718e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2355:x1869199342364032:12345-192.168.202.4@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1782607677.647595:0:9088:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1782607677.647600:0:9088:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1782607678 -> 1782607677 00002000:00010000:0.0:1782607677.647602:0:9088:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1782607677 00002000:00010000:0.0:1782607677.647605:0:9088:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1782607678 -> 1782607677 00002000:00010000:0.0:1782607677.647607:0:9088:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1782607677.647699:0:9088:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457718e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:2355:x1869199342364032:12345-192.168.202.4@tcp:2:lhsmtool_posix.0 Request processed in 341us (536us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1782607677.647707:0:9088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 44 00000100:00100000:0.0:1782607677.653884:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607677.654101:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342364288 00000100:00100000:1.0:1782607677.654121:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342364288 00000100:00100000:1.0:1782607677.654184:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 126 00000100:00100000:1.0:1782607677.654193:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457ff1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+15:10538:x1869199342364288:12345-192.168.202.4@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1782607677.654282:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb9e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.654299:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cb99f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe54 expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.654309:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb9e5 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.654357:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cb99f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe54 expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.654371:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cb99f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe54 expref: 15 pid: 5805 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607677.654385:0:5805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f4b6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1869199364396928:192.168.202.4@tcp:104: 00000100:00100000:1.0:1782607677.654488:0:5805:0:(client.c:2701:ptlrpc_set_wait()) set ffff97456a83fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1782607677.657838:0:5805:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f4b6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1869199364396928:192.168.202.4@tcp:104: 00010000:00010000:1.0:1782607677.657873:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb9e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607677.660105:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607677.660363:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342364416 00000100:00100000:1.0:1782607677.660374:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342364416 00010000:00010000:1.0:1782607677.660420:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cb99f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe54 expref: 16 pid: 5805 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607677.660460:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 56 00000100:00100000:1.0:1782607677.660471:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457ff1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+16:2356:x1869199342364416:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782607677.660487:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782607677.660494:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cb99f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe54 expref: 16 pid: 5805 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.660508:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cb99f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe54 expref: 16 pid: 5805 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.660554:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cb99f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe54 expref: 16 pid: 5805 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.660704:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff974543e77100) 00010000:00010000:1.0:1782607677.660709:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb9e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.660720:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb9e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.660728:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb9e5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.660758:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782607677.660911:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457ff1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+15:2356:x1869199342364416:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 441us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607677.660918:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 56 00010000:00010000:3.0:1782607677.661197:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb9e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.661206:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb9e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.661235:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb9e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.661242:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb9e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.661248:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb9e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.662625:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f466400 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:3.0:1782607677.662632:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb9e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.662643:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb9e5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.663429:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff974543e77100) 00010000:00010000:3.0:1782607677.663432:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1782607677.663438:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb9e5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.663444:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cb9e5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607677.663538:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457ff1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+14:10538:x1869199342364288:12345-192.168.202.4@tcp:55:lhsmtool_posix.0 Request processed in 9342us (9659us total) trans 0 rc -22/-22 00000100:00100000:3.0:1782607677.663550:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 126 00000100:00100000:2.0:1782607677.677030:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607677.677521:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342364544 00000100:00100000:3.0:1782607677.677531:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342364544 00000100:00100000:3.0:1782607677.677595:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 45 00000100:00100000:3.0:1782607677.677606:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457718ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:2357:x1869199342364544:12345-192.168.202.4@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1782607677.677656:0:6608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003a43fe72/0x8109266df35cb9ec lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.677677:0:6608:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000240a769d/0x8109266df35cb9c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe70 expref: 7 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.677686:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782607677.677689:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782607677.677693:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a43fe72/0x8109266df35cb9ec lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.677725:0:6608:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000240a769d/0x8109266df35cb9c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe70 expref: 7 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.677752:0:6608:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000240a769d/0x8109266df35cb9c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe70 expref: 7 pid: 6608 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607677.677784:0:6608:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974551140a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6608:1869199364397056:192.168.202.4@tcp:104: 00000100:00100000:3.0:1782607677.677862:0:6608:0:(client.c:2701:ptlrpc_set_wait()) set ffff974544ccbc00 going to sleep for 11 seconds 00000100:00100000:3.0:1782607677.688334:0:6608:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974551140a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6608:1869199364397056:192.168.202.4@tcp:104: 00010000:00010000:3.0:1782607677.688368:0:6608:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003a43fe72/0x8109266df35cb9ec lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607677.688671:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607677.688851:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342364672 00000100:00100000:1.0:1782607677.688858:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342364672 00010000:00010000:1.0:1782607677.688894:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000240a769d/0x8109266df35cb9c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe70 expref: 8 pid: 6608 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607677.688926:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 57 00000100:00100000:1.0:1782607677.688936:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457718f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+8:2357:x1869199342364672:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782607677.688951:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782607677.688985:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000240a769d/0x8109266df35cb9c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe70 expref: 8 pid: 6608 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.689017:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000240a769d/0x8109266df35cb9c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe70 expref: 8 pid: 6608 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.689040:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000240a769d/0x8109266df35cb9c9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe70 expref: 8 pid: 6608 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.689058:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782607677.689062:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782607677.689068:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003a43fe72/0x8109266df35cb9ec lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.689078:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a43fe72/0x8109266df35cb9ec lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.689120:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782607677.689171:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457718f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:2357:x1869199342364672:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 235us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607677.689179:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 57 00010000:00010000:0.0:1782607677.689566:0:6608:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003a43fe72/0x8109266df35cb9ec lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.689576:0:6608:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a43fe72/0x8109266df35cb9ec lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.689599:0:6608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003a43fe72/0x8109266df35cb9ec lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.689621:0:6608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a43fe72/0x8109266df35cb9ec lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.689629:0:6608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a43fe72/0x8109266df35cb9ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.689636:0:6608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d648e00 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:0.0:1782607677.689641:0:6608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a43fe72/0x8109266df35cb9ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.689651:0:6608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a43fe72/0x8109266df35cb9ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.689663:0:6608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a43fe72/0x8109266df35cb9ec lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.689671:0:6608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a43fe72/0x8109266df35cb9ec lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607677.689716:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457718ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2357:x1869199342364544:12345-192.168.202.4@tcp:1:lhsmtool_posix.0 Request processed in 12111us (12696us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607677.689722:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 45 00000100:00100000:1.0:1782607677.697821:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607677.697979:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342364928 00000100:00100000:2.0:1782607677.698015:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342364928 00000100:00100000:2.0:1782607677.698082:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 127 00000100:00100000:2.0:1782607677.698092:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+14:10538:x1869199342364928:12345-192.168.202.4@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1782607677.698197:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb9f3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607677.698215:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb9f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607677.698227:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb9f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607677.698739:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb9fa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607677.698751:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb9ad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe5b expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607677.698759:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb9fa lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607677.700198:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb9ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe5b expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607677.700218:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb9ad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe5b expref: 15 pid: 5805 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607677.700234:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457718c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5804:1869199364397184:192.168.202.4@tcp:104: 00000100:00100000:2.0:1782607677.700739:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff974551338780 going to sleep for 11 seconds 00000100:00100000:3.0:1782607677.712861:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457718c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5804:1869199364397184:192.168.202.4@tcp:104: 00010000:00010000:3.0:1782607677.712893:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb9fa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607677.715288:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607677.716882:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342365056 00000100:00100000:0.0:1782607677.716896:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342365056 00010000:00010000:0.0:1782607677.716945:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb9ad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe5b expref: 16 pid: 5805 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607677.717018:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 58 00000100:00100000:0.0:1782607677.717028:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+16:2356:x1869199342365056:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782607677.717046:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782607677.717054:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb9ad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe5b expref: 16 pid: 5805 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.717068:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb9ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe5b expref: 16 pid: 5805 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.717089:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cb9ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe5b expref: 16 pid: 5805 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.717116:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff974543e77100) 00010000:00010000:0.0:1782607677.717122:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb9fa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.717131:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb9fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.717139:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb9fa lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.717455:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782607677.717512:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+15:2356:x1869199342365056:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 485us (2231us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607677.717520:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 58 00010000:00010000:3.0:1782607677.722242:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb9fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.722404:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb9fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782607677.729200:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1782607677.729388:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1782607677.729436:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1782607677.729531:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457718ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5804:1869199364397312:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1782607677.729605:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607677.729903:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745813d0480 going to sleep for 11 seconds 00000100:00100000:0.0:1782607677.736050:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364397312 00000100:00100000:0.0:1782607677.736079:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364397312 00000100:00100000:0.0:1782607677.736242:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782607677.736254:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457718ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5804:x1869199364397312:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1782607677.736389:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457718ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5804:x1869199364397312:12345-0@lo:1000:mdt00_001.0 Request processed in 138us (6784us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607677.736397:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782607677.736491:0:5804:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:3.0:1782607677.736498:0:5804:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:3.0:1782607677.736526:0:5804:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974581008700, transno 4294967309 00000100:00100000:3.0:1782607677.736544:0:5804:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff974581009180 x1869199364396544/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1782607693 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607677.736555:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457718ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5804:1869199364397312:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1782607677.737285:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1782607677.737357:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974551140a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5804:1869199364397440:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1782607677.737407:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607677.750294:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff974541376780 going to sleep for 11 seconds 00000100:00100000:2.0:1782607677.750580:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364397440 00000100:00100000:2.0:1782607677.750591:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364397440 00000100:00100000:2.0:1782607677.750651:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782607677.750661:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974551141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5804:x1869199364397440:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1782607677.751159:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974551141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5804:x1869199364397440:12345-0@lo:1000:mdt00_001.0 Request processed in 498us (13750us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1782607677.751167:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782607677.751319:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974551140a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5804:1869199364397440:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1782607677.751363:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb9fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.751373:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb9fa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.751393:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb9fa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.751399:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ad000 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607677.751403:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb9fa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.751411:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb9fa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.751427:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff974543e77100) 00010000:00010000:1.0:1782607677.751430:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782607677.751435:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb9fa lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.751442:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cb9fa lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.751475:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466600/0x8109266df35cb93d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.751481:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466600/0x8109266df35cb93d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.751487:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466600/0x8109266df35cb93d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.751492:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f466600 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607677.751495:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466600/0x8109266df35cb93d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.751511:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466600/0x8109266df35cb93d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.751520:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9745432c6d00) 00010000:00010000:1.0:1782607677.751522:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782607677.751530:0:5804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42e00/0x8109266df35cb944 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe3f expref: 18 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.751541:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42e00/0x8109266df35cb944 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe3f expref: 18 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.751552:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42e00/0x8109266df35cb944 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe3f expref: 18 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.751588:0:5804:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42e00/0x8109266df35cb944 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe3f expref: 18 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607677.751603:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f4b4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5804:1869199364397568:192.168.202.4@tcp:105: 00000100:00100000:1.0:1782607677.751676:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff97456a83fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1782607677.762501:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607677.763261:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342365184 00000100:00100000:0.0:1782607677.763272:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342365184 00000100:00100000:0.0:1782607677.763325:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 31 00000100:00100000:0.0:1782607677.763337:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+19:10537:x1869199342365184:12345-192.168.202.4@tcp:49:lfs.0 00000100:00100000:0.0:1782607677.763479:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+19:10537:x1869199342365184:12345-192.168.202.4@tcp:49:lfs.0 Request processed in 143us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607677.763487:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 31 00000100:00100000:2.0:1782607677.763933:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f4b4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5804:1869199364397568:192.168.202.4@tcp:105: 00010000:00010000:2.0:1782607677.763961:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466600/0x8109266df35cb93d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607677.763973:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466600/0x8109266df35cb93d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607677.764007:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cba01 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607677.764019:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cba01 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607677.764030:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cba01 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607677.764039:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cba01 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607677.764063:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cba01 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607677.764071:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cba01 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607677.764077:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ace00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607677.764082:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cba01 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607677.764090:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cba01 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607677.765021:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9745432c6d00) 00010000:00010000:2.0:1782607677.765024:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607677.765029:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cba01 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607677.765035:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cba01 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607677.765050:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb9f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607677.765056:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb9f3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607677.765062:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb9f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607677.765067:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585acc00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607677.765082:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb9f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607677.765089:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb9f3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607677.765170:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9745432c6d00) 00010000:00010000:2.0:1782607677.765173:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782607677.765177:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb9f3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607677.765182:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cb9f3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607677.765496:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+18:10538:x1869199342364928:12345-192.168.202.4@tcp:57:lhsmtool_posix.0 Request processed in 67400us (67725us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1782607677.765508:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 127 00000020:00080000:2.0:1782607677.765514:0:5804:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1782607677.769039:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607677.769227:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342365440 00000100:00100000:2.0:1782607677.769239:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342365440 00000100:00100000:2.0:1782607677.769303:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 128 00000100:00100000:2.0:1782607677.769313:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974578dabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+18:10537:x1869199342365440:12345-192.168.202.4@tcp:58:lfs.0 00000040:00080000:2.0:1782607677.769691:0:7437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1782607677.769832:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974578dabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+18:10537:x1869199342365440:12345-192.168.202.4@tcp:58:lfs.0 Request processed in 519us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607677.769840:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 128 00000040:00080000:1.0:1782607677.771701:0:11563:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782607677.771712:0:11563:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782607677.771803:0:11563:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1782607677.771813:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782607677.771931:0:11563:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f4b7800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11563:1869199364397696:192.168.202.4@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1782607677.772014:0:11563:0:(client.c:2701:ptlrpc_set_wait()) set ffff97456a83fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1782607677.773835:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607677.774073:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342365696 00000100:00100000:0.0:1782607677.774082:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342365696 00000100:00100000:0.0:1782607677.774156:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 32 00000100:00100000:0.0:1782607677.774165:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549b89850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+19:10538:x1869199342365696:12345-192.168.202.4@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1782607677.774891:0:5806:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1782607677.774989:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1782607677.775032:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cba08 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.775049:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cba08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.775059:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cba08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.775078:0:5806:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cba08 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.775084:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cba08 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.775090:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cba08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607677.775104:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782607677.775197:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549b89850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+21:10538:x1869199342365696:12345-192.168.202.4@tcp:35:lhsmtool_posix.0 Request processed in 1031us (1367us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1782607677.775205:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 32 00000020:00080000:0.0:1782607677.775210:0:5806:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782607677.775798:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782607677.775805:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cba08 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.775812:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42a00 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:3.0:1782607677.775816:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cba08 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.775823:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cba08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.775836:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97454c8e3500) 00010000:00010000:3.0:1782607677.775839:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782607677.775843:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cba08 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.775848:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cba08 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.775867:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607677.775869:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607677.775870:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607677.787290:0:11563:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f4b7800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11563:1869199364397696:192.168.202.4@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782607677.790195:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607677.792653:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342365824 00000100:00100000:2.0:1782607677.792668:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342365824 00000100:00100000:2.0:1782607677.792781:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 129 00000100:00100000:2.0:1782607677.792793:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745776b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+20:10540:x1869199342365824:12345-192.168.202.4@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1782607677.792858:0:5803:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1782607677.792968:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745776b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+20:10540:x1869199342365824:12345-192.168.202.4@tcp:53:lhsmtool_posix.0 Request processed in 178us (2784us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607677.792977:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 129 00000100:00100000:3.0:1782607677.804881:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607677.805163:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342366080 00000100:00100000:2.0:1782607677.805173:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342366080 00000100:00100000:2.0:1782607677.805228:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 130 00000100:00100000:2.0:1782607677.805238:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745776b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+20:10540:x1869199342366080:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782607677.805267:0:7437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607677.805288:0:7437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cba0f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffe77 expref: -99 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607677.805395:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cba16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607677.805410:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cba16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607677.805421:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cba16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782607677.805433:0:7437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1782607677.805558:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cba0f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe77 expref: 23 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607677.805576:0:7437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cba16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe77 expref: 22 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607677.805608:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9745432c6d00) 00010000:00010000:2.0:1782607677.805611:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1782607677.805614:0:7437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585ace00, rc 0) 00000100:00100000:2.0:1782607677.805680:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745776b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+22:10540:x1869199342366080:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 Request processed in 442us (808us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1782607677.805687:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 130 00000100:00100000:3.0:1782607677.810488:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607677.810611:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342366208 00000100:00100000:1.0:1782607677.810623:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342366208 00000100:00100000:1.0:1782607677.810721:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 131 00000100:00100000:1.0:1782607677.810730:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745776b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+22:10541:x1869199342366208:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1782607677.810750:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607677.810809:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cba24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffe7e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.810874:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466000/0x8109266df35cba2b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.810887:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466000/0x8109266df35cba2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.810897:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466000/0x8109266df35cba2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.810912:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cba32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.810919:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cba32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.810925:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cba32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.811314:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466600/0x8109266df35cba39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.811325:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466200/0x8109266df35cb92f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe38 expref: 23 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.811346:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466600/0x8109266df35cba39 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.811381:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466200/0x8109266df35cb92f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe38 expref: 23 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.811396:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466200/0x8109266df35cb92f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe38 expref: 23 pid: 5805 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607677.811409:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f4b7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5804:1869199364397824:192.168.202.4@tcp:104: 00000100:00100000:1.0:1782607677.811486:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff97456a83fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1782607677.814192:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607677.814619:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342366464 00000100:00100000:2.0:1782607677.814629:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342366464 00000100:00100000:2.0:1782607677.814698:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 132 00000100:00100000:2.0:1782607677.814708:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457ff1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+24:10540:x1869199342366464:12345-192.168.202.4@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1782607677.814805:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cba40 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607677.814823:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cba40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607677.814835:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cba40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607677.815354:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cba40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607677.815363:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cba40 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607677.815370:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cba40 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607677.815394:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ad000 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607677.815399:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cba40 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607677.815406:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cba40 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607677.815419:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9745432c6d00) 00010000:00010000:2.0:1782607677.815422:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782607677.815427:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cba40 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607677.815432:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cba40 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607677.815697:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457ff1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+25:10540:x1869199342366464:12345-192.168.202.4@tcp:57:lhsmtool_posix.0 Request processed in 989us (1511us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1782607677.815706:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 132 00000040:00080000:1.0:1782607677.817725:0:11563:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782607677.817735:0:11563:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782607677.818978:0:11563:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1782607677.819161:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782607677.825354:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607677.825587:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f4b7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5804:1869199364397824:192.168.202.4@tcp:104: 00010000:00010000:1.0:1782607677.825615:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466600/0x8109266df35cba39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607677.825762:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342366720 00000100:00100000:0.0:1782607677.825852:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342366720 00000100:00100000:1.0:1782607677.826102:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 33 00000100:00100000:1.0:1782607677.826123:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745776b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+25:5569:x1869199342366720:12345-192.168.202.4@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1782607677.826365:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745776b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+26:5569:x1869199342366720:12345-192.168.202.4@tcp:35:ldlm_bl.0 Request processed in 244us (1021us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1782607677.826373:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 33 00000100:00100000:1.0:1782607677.837664:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607677.837801:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342366976 00000100:00100000:2.0:1782607677.837812:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342366976 00000100:00100000:2.0:1782607677.837867:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 34 00000100:00100000:2.0:1782607677.837877:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+26:10540:x1869199342366976:12345-192.168.202.4@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1782607677.839874:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607677.839978:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342367104 00000100:00100000:1.0:1782607677.839987:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342367104 00010000:00010000:1.0:1782607677.840037:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466200/0x8109266df35cb92f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe38 expref: 27 pid: 5805 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607677.840077:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 59 00000100:00100000:1.0:1782607677.840095:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745776b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+27:2356:x1869199342367104:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782607677.840119:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782607677.840126:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466200/0x8109266df35cb92f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe38 expref: 27 pid: 5805 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.840139:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466200/0x8109266df35cb92f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe38 expref: 27 pid: 5805 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.840160:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466200/0x8109266df35cb92f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe38 expref: 27 pid: 5805 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.840178:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9745432c6d00) 00010000:00010000:1.0:1782607677.840183:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466600/0x8109266df35cba39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.840192:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466600/0x8109266df35cba39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.840200:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466600/0x8109266df35cba39 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607677.840235:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782607677.840287:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745776b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+26:2356:x1869199342367104:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 202us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607677.840307:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 59 00010000:00010000:3.0:1782607677.840675:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466600/0x8109266df35cba39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.840685:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466600/0x8109266df35cba39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782607677.840726:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1782607677.840730:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782607677.840750:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466600/0x8109266df35cba39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.840791:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466600/0x8109266df35cba39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.840802:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466000/0x8109266df35cba2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.840809:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466000/0x8109266df35cba2b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.840816:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466000/0x8109266df35cba2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.840822:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f466000 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:3.0:1782607677.840826:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466000/0x8109266df35cba2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.840833:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466000/0x8109266df35cba2b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.840855:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97454c8e3300) 00010000:00010000:3.0:1782607677.840858:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782607677.840862:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466000/0x8109266df35cba2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.840868:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466000/0x8109266df35cba2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.840882:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cba32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.840888:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cba32 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.840895:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cba32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.840899:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f466c00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:3.0:1782607677.840902:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cba32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.840907:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cba32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.840914:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff974543e77100) 00010000:00010000:3.0:1782607677.840916:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782607677.840919:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cba32 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.840923:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cba32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.840968:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cba24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe7e expref: 26 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.840980:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466600/0x8109266df35cba39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe7e expref: 25 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607677.840987:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9745432c6d00) 00010000:00010000:3.0:1782607677.840989:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782607677.840992:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97457f466600, rc 0) 00000100:00100000:3.0:1782607677.841041:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745776b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+25:10541:x1869199342366208:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 30311us (30561us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607677.841048:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 131 00000100:00100000:0.0:1782607677.844135:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+25:10540:x1869199342366976:12345-192.168.202.4@tcp:35:lhsmtool_posix.0 Request processed in 6248us (6468us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1782607677.844150:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 34 00000100:00100000:2.0:1782607678.537122:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457ff1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364397952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782607678.537217:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607678.537298:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364397952 00000100:00100000:2.0:1782607678.537307:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364397952 00000100:00100000:2.0:1782607678.537378:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1782607678.537388:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457718ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1869199364397952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782607678.537420:0:6612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1782607678.537466:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457718ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1869199364397952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607678.537472:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1782607678.537518:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457ff1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364397952:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782607678.660147:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782607679.178741:0:11982:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782607679.178751:0:11982:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782607679.178841:0:11982:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1782607679.178846:0:11982:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782607679.474254:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607679.474302:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342367360 00000100:00100000:2.0:1782607679.474311:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342367360 00000100:00100000:2.0:1782607679.474376:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 133 00000100:00100000:2.0:1782607679.474386:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457718c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+25:10564:x1869199342367360:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1782607679.474412:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607679.474435:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cba47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffe85 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607679.474558:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cba4e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607679.474573:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cba4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607679.474586:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cba4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782607679.474597:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1782607679.474734:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cba47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe85 expref: 28 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607679.474755:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cba4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe85 expref: 27 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607679.474801:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9745432c6d00) 00010000:00010000:2.0:1782607679.474805:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1782607679.474808:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585acc00, rc 0) 00000100:00100000:2.0:1782607679.474865:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457718c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+27:10564:x1869199342367360:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 481us (622us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1782607679.474873:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 133 00000100:00080000:2.0:1782607679.474897:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782607679.482270:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607679.482628:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342367488 00000100:00100000:0.0:1782607679.482639:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342367488 00000100:00100000:0.0:1782607679.482705:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 134 00000100:00100000:0.0:1782607679.482715:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455d462300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+27:10564:x1869199342367488:12345-192.168.202.4@tcp:54:lfs.0 00010000:00010000:0.0:1782607679.482822:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42400/0x8109266df35cba5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607679.482841:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42400/0x8109266df35cba5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607679.482853:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42400/0x8109266df35cba5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607679.482879:0:7437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42400/0x8109266df35cba5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607679.482886:0:7437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42400/0x8109266df35cba5c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607679.482894:0:7437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42400/0x8109266df35cba5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607679.482901:0:7437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42400 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607679.482906:0:7437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42400/0x8109266df35cba5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607679.482914:0:7437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42400/0x8109266df35cba5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607679.482926:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9745432c6d00) 00010000:00010000:0.0:1782607679.482928:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782607679.482933:0:7437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42400/0x8109266df35cba5c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607679.482939:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42400/0x8109266df35cba5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607679.483242:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455d462300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+27:10564:x1869199342367488:12345-192.168.202.4@tcp:54:lfs.0 Request processed in 526us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607679.483250:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 134 00000100:00100000:2.0:1782607679.631069:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607679.631208:0:9088:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342367616 00000100:00100000:0.0:1782607679.631218:0:9088:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342367616 00000100:00100000:0.0:1782607679.631342:0:9088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 46 00000100:00100000:0.0:1782607679.631362:0:9088:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455d461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2354:x1869199342367616:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1782607679.631378:0:9088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607679.631393:0:9088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ccd1157/0x8109266df35cba63 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffe8c expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782607679.631419:0:9088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a406f3d, atime: 0x6a406f3d, ctime: 0x6a406f3d, blocks: 0xb 00010000:00010000:0.0:1782607679.631437:0:9088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=338s v=(0 0) 00010000:00010000:0.0:1782607679.631441:0:9088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607679.631448:0:9088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ccd1157/0x8109266df35cba63 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe8c expref: 7 pid: 9088 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607679.631461:0:9088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005ccd1157/0x8109266df35cba63 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe8c expref: 7 pid: 9088 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607679.631471:0:9088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c42400, rc 0) 00000100:00100000:0.0:1782607679.631523:0:9088:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455d461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:2354:x1869199342367616:12345-192.168.202.4@tcp:101:cat.0 Request processed in 173us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607679.631527:0:9088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 46 00000100:00080000:2.0:1782607679.631730:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782607679.644282:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607679.646462:0:6615:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342367744 00000100:00100000:0.0:1782607679.646489:0:6615:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342367744 00002000:00100000:0.0:1782607679.646540:0:6615:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff974567327b80 x1869199342367744/t0(0) o3->d72d7fb9-639f-4ad9-b658-df715cbf7792@192.168.202.4@tcp:595/0 lens 488/0 e 0 to 0 dl 1782607690 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782607679.646549:0:6615:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974567327b80 with x1869199342367744 ext(0->4095) 00002000:00010000:0.0:1782607679.646554:0:6615:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974567327b80 00000100:00100000:0.0:1782607679.646635:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 3 00000100:00100000:0.0:1782607679.646646:0:6615:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974567327b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:2354:x1869199342367744:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:0.0:1782607679.646854:0:6615:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974567327b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:2354:x1869199342367744:12345-192.168.202.4@tcp:3:cat.0 Request processed in 208us (2582us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1782607679.646861:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 3 00002000:00100000:0.0:1782607679.646868:0:6615:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff974567327b80 x1869199342367744/t0(0) o3->d72d7fb9-639f-4ad9-b658-df715cbf7792@192.168.202.4@tcp:595/0 lens 488/4536 e 0 to 0 dl 1782607690 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782607679.646875:0:6615:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974567327b80 with x1869199342367744 ext(0->4095) 00002000:00010000:0.0:1782607679.646879:0:6615:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974567327b80 00010000:00010000:0.0:1782607679.682024:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782607680.067112:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457ff1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364398080:0@lo:400:kworker.0 00000100:00100000:3.0:1782607680.067200:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607680.067294:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364398080 00000100:00100000:1.0:1782607680.067303:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364398080 00000100:00100000:1.0:1782607680.067366:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1782607680.067375:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3319:x1869199364398080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607680.067825:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364398464:0@lo:400:kworker.0 00000100:00100000:2.0:1782607680.067864:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607680.067903:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974541322a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1869199364398336:0@lo:400:kworker.0 00000100:00100000:2.0:1782607680.067931:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607680.067950:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782607680.067956:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974541321880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869199364398208:0@lo:400:kworker.0 00000100:00100000:2.0:1782607680.067991:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607680.068017:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364398336 00000100:00100000:2.0:1782607680.068021:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364398336 00000100:00100000:2.0:1782607680.068056:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364398208 00000100:00100000:2.0:1782607680.068059:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364398208 00000100:00100000:2.0:1782607680.068080:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1782607680.068087:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97454773a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869199364398336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607680.068153:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97454773a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869199364398336:12345-0@lo:400:kworker.0 Request processed in 65us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607680.068175:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1782607680.068193:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1782607680.068200:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97454773b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869199364398208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607680.068231:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97454773b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869199364398208:12345-0@lo:400:kworker.0 Request processed in 32us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607680.068237:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:2.0:1782607680.068263:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782607680.068290:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974541321880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869199364398208:0@lo:400:kworker.0 00000100:00100000:2.0:1782607680.068302:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974541322a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1869199364398336:0@lo:400:kworker.0 00000100:00100000:2.0:1782607680.068373:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364398464 00000100:00100000:2.0:1782607680.068377:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364398464 00000100:00100000:2.0:1782607680.068412:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1782607680.068419:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974547738e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3318:x1869199364398464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607680.068456:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974547738e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3318:x1869199364398464:12345-0@lo:400:kworker.0 Request processed in 37us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607680.068462:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1782607680.068476:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782607680.068874:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364398464:0@lo:400:kworker.0 00000100:00100000:1.0:1782607680.069138:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3319:x1869199364398080:12345-0@lo:400:kworker.0 Request processed in 1752us (1927us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607680.069147:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1782607680.069431:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782607680.069442:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1869199364398592:0@lo:400:kworker.0 00000100:00100000:2.0:1782607680.069476:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607680.069517:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782607680.069524:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581008700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364398720:0@lo:400:kworker.0 00000100:00100000:2.0:1782607680.069548:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607680.069798:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364398720 00000100:00100000:1.0:1782607680.069804:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364398720 00000100:00100000:1.0:1782607680.069849:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1782607680.069856:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97454773a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3317:x1869199364398720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607680.069894:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97454773a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3317:x1869199364398720:12345-0@lo:400:kworker.0 Request processed in 39us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607680.069900:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1782607680.069928:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581008700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364398720:0@lo:400:kworker.0 00000100:00100000:0.0:1782607680.069998:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364398592 00000100:00100000:0.0:1782607680.070003:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364398592 00000100:00100000:0.0:1782607680.070039:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1782607680.070046:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974547739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869199364398592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607680.070080:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974547739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869199364398592:12345-0@lo:400:kworker.0 Request processed in 35us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607680.070085:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1782607680.070122:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1869199364398592:0@lo:400:kworker.0 00000100:00080000:2.0:1782607680.070335:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782607680.070339:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782607680.070500:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457ff1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364398080:0@lo:400:kworker.0 00010000:00010000:3.0:1782607680.707566:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782607681.253717:0:7525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:0.0:1782607681.253737:0:7525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00010000:00010000:0.0:1782607681.731003:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782607681.772432:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607681.772494:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607681.772528:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607681.772549:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607681.772853:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342367872 00000100:00100000:2.0:1782607681.772868:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342367872 00000100:00100000:2.0:1782607681.772940:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 292 00000100:00100000:2.0:1782607681.772952:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2357:x1869199342367872:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1782607681.773185:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342368128 00000100:00100000:0.0:1782607681.773190:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342368128 00000100:00100000:0.0:1782607681.773242:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 85 00000100:00100000:0.0:1782607681.773250:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745776b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:2357:x1869199342368128:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607681.774868:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2357:x1869199342367872:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 1908us (2441us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607681.774883:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 292 00000100:00100000:2.0:1782607681.774954:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342368384 00000100:00100000:2.0:1782607681.778700:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342368384 00000100:00100000:2.0:1782607681.778851:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342368000 00000100:00100000:2.0:1782607681.778856:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342368000 00000100:00100000:2.0:1782607681.778898:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 147 00000100:00100000:2.0:1782607681.778911:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745776b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2357:x1869199342368384:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1782607681.779173:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607681.780785:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 148 00000100:00100000:0.0:1782607681.780809:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457ff1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+27:2357:x1869199342368000:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1782607681.780901:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457ff1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+27:2357:x1869199342368000:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 102us (8349us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607681.780910:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 148 00000100:00080000:0.0:1782607681.780947:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782607681.780954:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782607681.781094:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745776b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2357:x1869199342368384:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 2185us (8563us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607681.781103:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 147 00000100:00100000:2.0:1782607681.781141:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342368256 00000100:00100000:2.0:1782607681.781151:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342368256 00000100:00100000:2.0:1782607681.781204:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 86 00000100:00100000:2.0:1782607681.781211:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9744437c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2357:x1869199342368256:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607681.781239:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9744437c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2357:x1869199342368256:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 29us (2069us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607681.781246:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 86 00000100:00080000:0.0:1782607681.782423:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782607681.782550:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745776b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:2357:x1869199342368128:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 9293us (10047us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607681.782562:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 85 00000100:00100000:3.0:1782607682.626101:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782607682.626133:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f4b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364398848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782607682.626268:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607682.626429:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364398848 00000100:00100000:1.0:1782607682.626437:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364398848 00000100:00100000:1.0:1782607682.626504:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1782607682.626513:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9744437c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364398848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782607682.626559:0:6612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782607682.626617:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9744437c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364398848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607682.626624:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1782607682.626939:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782607682.626990:0:3316:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1782607682.626997:0:3316:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1782607682.627238:0:3316:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97457f4b5880, transno 4294967304 00000100:00100000:3.0:1782607682.627441:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f4b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364398848:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1782607682.724622:0:6634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:2.0:1782607682.724650:0:6634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:2.0:1782607682.726705:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967408 is committed 00000020:00080000:2.0:1782607682.726734:0:5825:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:2.0:1782607682.726759:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000004:00080000:2.0:1782607682.726801:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000001:00080000:2.0:1782607682.726818:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1782607682.726850:0:5825:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff974544ccbc00 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1782607682.726856:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff974547f95500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff974544ccbe40 00000020:00080000:2.0:1782607682.726860:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff974547f95700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97457ff25400 00000020:00080000:0.0:1782607682.726914:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1782607682.727176:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:0.0:1782607682.754257:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782607682.946758:0:11563:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782607682.946796:0:11563:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782607682.946844:0:11563:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1782607682.946856:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782607683.653805:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782607683.653838:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581008700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364398976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782607683.653935:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607683.654035:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364398976 00000100:00100000:0.0:1782607683.654046:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364398976 00000100:00100000:0.0:1782607683.654139:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1782607683.654151:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745509edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364398976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782607683.654203:0:6612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782607683.654276:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745509edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364398976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607683.654285:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1782607683.654308:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782607683.654340:0:3319:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1782607683.654347:0:3319:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974581009180, transno 4294967310 00000004:00080000:0.0:1782607683.654359:0:3319:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:0.0:1782607683.654392:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581008700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364398976:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782607683.777933:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607684.820258:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782607685.189418:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974541321880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364399488:0@lo:400:kworker.0 00000100:00100000:2.0:1782607685.189519:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607685.191215:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782607685.191234:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974547739880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fae11c6e-4506-4104-bb8c-df42498f7e08:3318:1869199364399104:0@lo:400:kworker.0 00000100:00100000:2.0:1782607685.191296:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607685.191323:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457fad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1869199364399616:0@lo:400:kworker.0 00000100:00100000:2.0:1782607685.191347:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607685.191383:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974541322a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1869199364399360:0@lo:400:kworker.0 00000100:00100000:2.0:1782607685.191405:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607685.191421:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1782607685.191426:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974541320000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869199364399232:0@lo:400:kworker.0 00000100:00100000:2.0:1782607685.191459:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607685.191475:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457fad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364399744:0@lo:400:kworker.0 00000100:00100000:2.0:1782607685.191495:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607685.191521:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364399488 00000100:00100000:2.0:1782607685.191528:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364399488 00000100:00100000:2.0:1782607685.191571:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364399744 00000100:00100000:2.0:1782607685.191573:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364399744 00000100:00100000:2.0:1782607685.191600:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1782607685.191607:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457fad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364399488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607685.191694:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364399616 00000100:00100000:0.0:1782607685.191707:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364399616 00000100:00100000:0.0:1782607685.191760:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364399360 00000100:00100000:0.0:1782607685.191778:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364399360 00000100:00100000:0.0:1782607685.191807:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364399232 00000100:00100000:0.0:1782607685.191810:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364399232 00000100:00100000:0.0:1782607685.191827:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1782607685.191836:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457fad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869199364399616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607685.191921:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457fad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869199364399616:12345-0@lo:400:kworker.0 Request processed in 85us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607685.191929:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1782607685.192030:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1782607685.192037:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457fad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869199364399360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607685.192089:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457fad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869199364399360:12345-0@lo:400:kworker.0 Request processed in 52us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607685.192095:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1782607685.192106:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1782607685.192111:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457fad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869199364399232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607685.192172:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457fad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364399488:12345-0@lo:400:kworker.0 Request processed in 561us (2650us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607685.192181:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1782607685.192201:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1782607685.192209:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457fad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364399744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607685.192242:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457fad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364399744:12345-0@lo:400:kworker.0 Request processed in 36us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607685.192248:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1782607685.192265:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364399104 00000100:00100000:2.0:1782607685.192269:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364399104 00000100:00100000:2.0:1782607685.192293:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1782607685.192299:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3318:x1869199364399104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607685.192898:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3318:x1869199364399104:12345-0@lo:400:kworker.0 Request processed in 597us (1600us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607685.192906:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1782607685.193206:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457fad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869199364399232:12345-0@lo:400:kworker.0 Request processed in 1090us (1755us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607685.193215:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:0.0:1782607685.193251:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782607685.193258:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782607685.193261:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782607685.193327:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974541320000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869199364399232:0@lo:400:kworker.0 00000100:00100000:0.0:1782607685.193344:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457fad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364399744:0@lo:400:kworker.0 00000100:00100000:0.0:1782607685.193358:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974541322a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1869199364399360:0@lo:400:kworker.0 00000100:00100000:0.0:1782607685.193407:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974547739880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fae11c6e-4506-4104-bb8c-df42498f7e08:3318:1869199364399104:0@lo:400:kworker.0 00000100:00100000:0.0:1782607685.193421:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457fad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1869199364399616:0@lo:400:kworker.0 00000100:00100000:0.0:1782607685.193434:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974541321880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364399488:0@lo:400:kworker.0 00010000:00010000:0.0:1782607685.827479:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782607686.457652:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607686.457933:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342368512 00000100:00100000:0.0:1782607686.457949:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342368512 00000100:00100000:0.0:1782607686.458065:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 135 00000100:00100000:0.0:1782607686.458079:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457fad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+14:10217:x1869199342368512:12345-192.168.202.4@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1782607686.458245:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457fad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+14:10217:x1869199342368512:12345-192.168.202.4@tcp:60:lhsmtool_posix.0 Request processed in 168us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607686.458253:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 135 00000100:00080000:2.0:1782607686.458695:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782607686.466285:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607686.466884:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342368768 00000100:00100000:0.0:1782607686.466898:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342368768 00000100:00100000:0.0:1782607686.466975:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 35 00000100:00100000:0.0:1782607686.466986:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457fad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+14:10217:x1869199342368768:12345-192.168.202.4@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1782607686.467633:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457fad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+15:10217:x1869199342368768:12345-192.168.202.4@tcp:35:lhsmtool_posix.0 Request processed in 647us (1366us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1782607686.467641:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 35 00010000:00010000:3.0:1782607686.850613:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607686.880089:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607686.880247:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342368896 00000100:00100000:0.0:1782607686.880261:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342368896 00000100:00100000:0.0:1782607686.880646:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 136 00000100:00100000:0.0:1782607686.880661:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d45e125-365f-42d9-9f91-770009f5d4b0+5:11016:x1869199342368896:12345-192.168.202.4@tcp:101:lsof.0 00010000:00010000:0.0:1782607686.880692:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607686.880719:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cba6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffe93 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607686.880853:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cba71 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607686.880872:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cba71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607686.880886:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cba71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782607686.881193:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782607686.881199:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1782607686.881312:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cba71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607686.881806:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cba6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe93 expref: 7 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607686.881834:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cba71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe93 expref: 6 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607686.881855:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff974543e77800) 00010000:00010000:0.0:1782607686.881859:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782607686.881864:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c43200, rc 0) 00000100:00100000:0.0:1782607686.881967:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d45e125-365f-42d9-9f91-770009f5d4b0+6:11016:x1869199342368896:12345-192.168.202.4@tcp:101:lsof.0 Request processed in 1310us (1896us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607686.881977:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 136 00000100:00080000:2.0:1782607686.882077:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782607686.897438:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607686.897494:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607686.897546:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607686.897586:0:9088:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342369280 00000100:00100000:2.0:1782607686.897599:0:9088:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342369280 00000100:00100000:2.0:1782607686.897677:0:9088:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342369152 00000100:00100000:2.0:1782607686.897699:0:9088:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342369152 00000100:00100000:2.0:1782607686.897733:0:9088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 89 00000100:00100000:2.0:1782607686.897745:0:9088:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457fad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2355:x1869199342369280:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607686.897888:0:9088:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457fad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2355:x1869199342369280:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 145us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607686.897897:0:9088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 89 00000100:00100000:2.0:1782607686.897932:0:9088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 90 00000100:00100000:2.0:1782607686.897939:0:9088:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457fad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2355:x1869199342369152:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607686.897965:0:9088:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457fad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2355:x1869199342369152:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 27us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607686.897971:0:9088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 90 00000100:00080000:2.0:1782607686.897999:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782607686.898003:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782607686.898955:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342369024 00000100:00100000:3.0:1782607686.898966:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342369024 00000100:00100000:3.0:1782607686.899023:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 294 00000100:00100000:3.0:1782607686.899031:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2355:x1869199342369024:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1782607686.899108:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2355:x1869199342369024:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 78us (1686us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607686.899116:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 294 00000100:00100000:1.0:1782607687.747748:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782607687.747801:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f4b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364399872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782607687.747898:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607687.768668:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364399872 00000100:00100000:2.0:1782607687.768683:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364399872 00000100:00100000:2.0:1782607687.768815:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1782607687.768828:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f387800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364399872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782607687.768875:0:6612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782607687.768971:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f387800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364399872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 147us (21072us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607687.768979:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1782607687.769046:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f4b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364399872:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1782607687.769086:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1782607687.918753:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782607687.933586:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1782607687.933609:0:5825:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1782607687.933927:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1782607687.933941:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1782607688.770101:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974547739880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364400000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782607688.770204:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607688.770495:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364400000 00000100:00100000:0.0:1782607688.770505:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364400000 00000100:00100000:0.0:1782607688.770577:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1782607688.770588:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458112b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364400000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782607688.770629:0:6612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1782607688.770787:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782607688.770844:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458112b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364400000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 257us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607688.770852:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1782607688.781704:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974547739880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364400000:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782607688.964102:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607689.994914:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607690.308242:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457fad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364400128:0@lo:400:kworker.0 00000100:00100000:1.0:1782607690.308319:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607690.308373:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457fad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1869199364400640:0@lo:400:kworker.0 00000100:00100000:1.0:1782607690.308401:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607690.308429:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782607690.308434:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457fad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364400512:0@lo:400:kworker.0 00000100:00100000:1.0:1782607690.308463:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607690.308502:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364400640 00000100:00100000:1.0:1782607690.308510:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364400640 00000100:00100000:1.0:1782607690.308573:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1782607690.308583:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f384e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1869199364400640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607690.308639:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f384e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1869199364400640:12345-0@lo:400:kworker.0 Request processed in 57us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607690.308646:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1782607690.308689:0:9088:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364400512 00000100:00100000:1.0:1782607690.308692:0:9088:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364400512 00000100:00100000:1.0:1782607690.308722:0:9088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1782607690.308729:0:9088:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f384000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364400512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607690.308759:0:9088:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f384000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364400512:12345-0@lo:400:kworker.0 Request processed in 30us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607690.308804:0:9088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:1.0:1782607690.308826:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782607690.308830:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782607690.308858:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457fad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364400512:0@lo:400:kworker.0 00000100:00100000:1.0:1782607690.308870:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457fad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1869199364400640:0@lo:400:kworker.0 00000100:00100000:2.0:1782607690.311115:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364400128 00000100:00100000:2.0:1782607690.311130:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364400128 00000100:00100000:2.0:1782607690.311201:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1782607690.311212:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3319:x1869199364400128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607690.311294:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3319:x1869199364400128:12345-0@lo:400:kworker.0 Request processed in 84us (2975us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607690.311301:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1782607690.311418:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457fad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364400128:0@lo:400:kworker.0 00000100:00100000:0.0:1782607690.311898:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457fad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869199364400256:0@lo:400:kworker.0 00000100:00100000:0.0:1782607690.311939:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607690.311974:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457fad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364400768:0@lo:400:kworker.0 00000100:00100000:0.0:1782607690.312000:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607690.312035:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782607690.312043:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457fad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1869199364400384:0@lo:400:kworker.0 00000100:00100000:0.0:1782607690.312067:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607690.312149:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364400256 00000100:00100000:3.0:1782607690.312154:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364400256 00000100:00100000:3.0:1782607690.312194:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364400384 00000100:00100000:3.0:1782607690.312197:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364400384 00000100:00100000:3.0:1782607690.312229:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1782607690.312236:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974547738a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869199364400256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607690.312280:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974547738a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869199364400256:12345-0@lo:400:kworker.0 Request processed in 44us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607690.312286:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1782607690.312301:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1782607690.312306:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869199364400384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607690.312347:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869199364400384:12345-0@lo:400:kworker.0 Request processed in 42us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607690.312354:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:3.0:1782607690.312373:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782607690.312396:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457fad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1869199364400384:0@lo:400:kworker.0 00000100:00100000:3.0:1782607690.312406:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457fad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869199364400256:0@lo:400:kworker.0 00000100:00100000:2.0:1782607690.312477:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364400768 00000100:00100000:2.0:1782607690.312482:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364400768 00000100:00100000:2.0:1782607690.312519:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1782607690.312525:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974547739880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364400768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607690.312559:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974547739880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364400768:12345-0@lo:400:kworker.0 Request processed in 34us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607690.312564:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:3.0:1782607690.312946:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782607690.312968:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457fad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364400768:0@lo:400:kworker.0 00010000:00010000:2.0:1782607691.010016:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782607691.300632:0:12185:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 20:48:10 (1782607690) 00000100:00100000:2.0:1782607692.012700:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607692.012790:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607692.012832:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607692.012871:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607692.012904:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607692.013962:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342369536 00000100:00100000:3.0:1782607692.013986:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342369536 00000100:00100000:3.0:1782607692.014069:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342369920 00000100:00100000:3.0:1782607692.014073:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342369920 00000100:00100000:3.0:1782607692.014101:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 155 00000100:00100000:3.0:1782607692.014112:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457fad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+14:2355:x1869199342369536:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1782607692.014195:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457fad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+14:2355:x1869199342369536:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 84us (1505us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607692.014203:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 155 00000100:00100000:3.0:1782607692.014220:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 156 00000100:00100000:3.0:1782607692.014227:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457fad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d45e125-365f-42d9-9f91-770009f5d4b0+6:2355:x1869199342369920:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1782607692.014252:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457fad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d45e125-365f-42d9-9f91-770009f5d4b0+6:2355:x1869199342369920:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 26us (1347us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607692.014259:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 156 00000100:00100000:1.0:1782607692.014364:0:9088:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342369792 00000100:00100000:1.0:1782607692.014369:0:9088:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342369792 00000100:00100000:1.0:1782607692.014406:0:9088:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342369664 00000100:00100000:1.0:1782607692.014409:0:9088:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342369664 00000100:00100000:1.0:1782607692.014436:0:9088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 93 00000100:00100000:1.0:1782607692.014443:0:9088:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457fad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2355:x1869199342369792:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1782607692.014474:0:9088:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457fad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2355:x1869199342369792:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 33us (1710us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607692.014481:0:9088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 93 00000100:00100000:1.0:1782607692.014494:0:9088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 94 00000100:00100000:1.0:1782607692.014500:0:9088:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457fad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2355:x1869199342369664:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1782607692.014523:0:9088:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457fad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2355:x1869199342369664:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 23us (1651us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607692.014529:0:9088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 94 00000100:00100000:0.0:1782607692.014739:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342369408 00000100:00100000:0.0:1782607692.014744:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342369408 00000100:00100000:0.0:1782607692.014814:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 296 00000100:00100000:0.0:1782607692.014821:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2355:x1869199342369408:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1782607692.014850:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2355:x1869199342369408:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 30us (2018us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607692.014867:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 296 00000100:00080000:2.0:1782607692.016868:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782607692.016877:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782607692.016881:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782607692.034153:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782607692.166291:0:11563:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782607692.166301:0:11563:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782607692.166834:0:11563:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1782607692.166842:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782607692.868178:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782607692.868202:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f387800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364400896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782607692.868272:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607692.869479:0:6613:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364400896 00000100:00100000:1.0:1782607692.869491:0:6613:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364400896 00000100:00100000:1.0:1782607692.869561:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1782607692.869583:0:6613:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457fad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364400896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782607692.869620:0:6613:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782607692.869698:0:6613:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457fad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364400896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (1425us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607692.869706:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1782607692.870538:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f387800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364400896:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1782607692.871139:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782607693.021438:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607693.021625:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342370176 00000100:00100000:3.0:1782607693.021643:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342370176 00000100:00100000:3.0:1782607693.021745:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 137 00000100:00100000:3.0:1782607693.021759:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+14:11281:x1869199342370176:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782607693.021880:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607693.021911:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cba78 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffe9a expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607693.022034:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cba7f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607693.022052:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cba7f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607693.022066:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cba7f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607693.022085:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649000/0x8109266df35cba86 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607693.022092:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649000/0x8109266df35cba86 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607693.022098:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649000/0x8109266df35cba86 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607693.022628:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cba8d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607693.022639:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cba8d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607693.022646:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cba8d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782607693.022671:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1782607693.022964:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cba7f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607693.022974:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cba7f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607693.022981:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cba7f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607693.023001:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d649a00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:3.0:1782607693.023007:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cba7f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607693.023016:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cba7f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607693.023031:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9745432c6e00) 00010000:00010000:3.0:1782607693.023035:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782607693.023041:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cba7f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607693.023048:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cba7f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607693.023064:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649000/0x8109266df35cba86 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607693.023071:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649000/0x8109266df35cba86 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607693.023087:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649000/0x8109266df35cba86 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607693.023092:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d649000 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:3.0:1782607693.023095:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649000/0x8109266df35cba86 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607693.023102:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649000/0x8109266df35cba86 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607693.023110:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9745454f5500) 00010000:00010000:3.0:1782607693.023113:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782607693.023116:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649000/0x8109266df35cba86 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607693.023121:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649000/0x8109266df35cba86 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607693.032719:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cba78 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe9a expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607693.032748:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cba8d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe9a expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607693.032757:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97454c8e3f00) 00010000:00010000:3.0:1782607693.032760:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782607693.032793:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97455d649400, rc 0) 00000100:00100000:3.0:1782607693.033011:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+16:11281:x1869199342370176:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 Request processed in 11253us (11580us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1782607693.033156:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 137 00000100:00100000:1.0:1782607693.041957:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607693.042968:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342370304 00000100:00100000:2.0:1782607693.042978:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342370304 00000100:00100000:2.0:1782607693.043068:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 138 00000100:00100000:2.0:1782607693.043078:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f387800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+16:11281:x1869199342370304:12345-192.168.202.4@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1782607693.049642:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f387800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+16:11281:x1869199342370304:12345-192.168.202.4@tcp:59:lhsmtool_posix.0 Request processed in 6553us (7683us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607693.049657:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 138 00000100:00100000:1.0:1782607693.050920:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607693.051056:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342370432 00000100:00100000:3.0:1782607693.051067:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342370432 00000100:00100000:3.0:1782607693.051137:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 9 00000100:00100000:3.0:1782607693.051149:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974548805850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+16:2355:x1869199342370432:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782607693.051167:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782607693.051194:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cba8d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe9a expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607693.051214:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97454c8e3f00) 00010000:00010000:3.0:1782607693.051219:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782607693.051279:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974548805850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+15:2355:x1869199342370432:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 132us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607693.051287:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 9 00010000:00010000:2.0:1782607693.058186:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782607693.201289:0:11563:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782607693.201298:0:11563:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782607693.206066:0:11563:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1782607693.206088:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782607693.892007:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782607693.892072:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745508c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364401024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782607693.892149:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607693.892222:0:6613:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364401024 00000100:00100000:0.0:1782607693.892228:0:6613:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364401024 00000100:00100000:0.0:1782607693.892283:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1782607693.892293:0:6613:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364401024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782607693.892329:0:6613:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782607693.892390:0:6613:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364401024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607693.892398:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1782607693.892461:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745508c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364401024:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782607693.892691:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782607694.081971:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607695.108200:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782607695.426536:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580e51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869199364401280:0@lo:400:kworker.0 00000100:00100000:0.0:1782607695.426611:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607695.426659:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457ff1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364401792:0@lo:400:kworker.0 00000100:00100000:0.0:1782607695.426682:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607695.426723:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782607695.426729:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580e53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1869199364401408:0@lo:400:kworker.0 00000100:00100000:0.0:1782607695.426750:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607695.426873:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457ff1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364401536:0@lo:400:kworker.0 00000100:00100000:3.0:1782607695.426902:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607695.426958:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782607695.426964:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745508c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fae11c6e-4506-4104-bb8c-df42498f7e08:3318:1869199364401152:0@lo:400:kworker.0 00000100:00100000:3.0:1782607695.427001:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607695.427030:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457ff1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1869199364401664:0@lo:400:kworker.0 00000100:00100000:3.0:1782607695.427052:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607695.427081:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364401792 00000100:00100000:3.0:1782607695.427088:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364401792 00000100:00100000:3.0:1782607695.427133:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364401536 00000100:00100000:3.0:1782607695.427136:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364401536 00000100:00100000:3.0:1782607695.427170:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1782607695.427177:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364401792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607695.427226:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364401792:12345-0@lo:400:kworker.0 Request processed in 49us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607695.427233:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1782607695.427249:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1782607695.427255:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9744437c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364401536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607695.427281:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9744437c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364401536:12345-0@lo:400:kworker.0 Request processed in 27us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607695.427286:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1782607695.427302:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364401152 00000100:00100000:3.0:1782607695.427305:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364401152 00000100:00100000:3.0:1782607695.427327:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1782607695.427333:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3318:x1869199364401152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607695.427359:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3318:x1869199364401152:12345-0@lo:400:kworker.0 Request processed in 27us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607695.427365:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00080000:3.0:1782607695.427387:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782607695.427391:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782607695.427417:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745508c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fae11c6e-4506-4104-bb8c-df42498f7e08:3318:1869199364401152:0@lo:400:kworker.0 00000100:00100000:3.0:1782607695.427428:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457ff1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364401536:0@lo:400:kworker.0 00000100:00100000:1.0:1782607695.434423:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364401280 00000100:00100000:1.0:1782607695.434439:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364401280 00000100:00100000:1.0:1782607695.434511:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364401408 00000100:00100000:1.0:1782607695.434515:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364401408 00000100:00100000:1.0:1782607695.434535:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364401664 00000100:00100000:1.0:1782607695.434538:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364401664 00000100:00100000:1.0:1782607695.434559:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1782607695.434569:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457ff1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869199364401280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607695.434666:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457ff1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869199364401280:12345-0@lo:400:kworker.0 Request processed in 99us (8055us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607695.434673:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1782607695.434690:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1782607695.434696:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869199364401408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607695.434721:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869199364401408:12345-0@lo:400:kworker.0 Request processed in 26us (7970us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607695.434727:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1782607695.434737:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1782607695.434742:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9744437c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869199364401664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607695.434801:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9744437c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869199364401664:12345-0@lo:400:kworker.0 Request processed in 57us (7747us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607695.434825:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:3.0:1782607695.434949:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782607695.435000:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457ff1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1869199364401664:0@lo:400:kworker.0 00000100:00100000:0.0:1782607695.437116:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580e53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1869199364401408:0@lo:400:kworker.0 00000100:00100000:0.0:1782607695.437135:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580e51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869199364401280:0@lo:400:kworker.0 00000100:00100000:0.0:1782607695.437147:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457ff1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364401792:0@lo:400:kworker.0 00000100:00100000:0.0:1782607695.744068:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607695.746026:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342370560 00000100:00100000:2.0:1782607695.746038:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342370560 00000100:00080000:3.0:1782607695.746110:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782607695.746224:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 139 00000100:00100000:2.0:1782607695.746237:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+15:11324:x1869199342370560:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1782607695.746259:0:7437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607695.746322:0:7437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cba9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffea1 expref: -99 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607695.746390:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cbaa2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607695.746417:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cbaa2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607695.746429:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cbaa2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607695.746510:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cbaa9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607695.746519:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cbaa9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607695.746526:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cbaa9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607695.746841:0:7437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cbaa2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607695.748818:0:7437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cbaa2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607695.748826:0:7437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cbaa2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607695.748832:0:7437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ada00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607695.748837:0:7437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cbaa2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607695.749932:0:7437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cbaa2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607695.749953:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff974543e77800) 00010000:00010000:2.0:1782607695.750234:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607695.750241:0:7437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cbaa2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607695.750249:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cbaa2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607695.750269:0:7437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cbaa9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607695.750276:0:7437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cbaa9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607695.750282:0:7437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cbaa9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607695.750287:0:7437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974540030600 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607695.750290:0:7437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cbaa9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607695.750296:0:7437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cbaa9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607695.750304:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9745432c6c00) 00010000:00010000:2.0:1782607695.750306:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607695.750309:0:7437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cbaa9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607695.750315:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cbaa9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607695.750364:0:7437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cba9b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffea1 expref: 16 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607695.750385:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff974543e77800) 00010000:00010000:2.0:1782607695.750387:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607695.750392:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cba9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffea1 expref: 16 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607695.750401:0:7437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585ad000, rc 0) 00000100:00100000:2.0:1782607695.752090:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+15:11324:x1869199342370560:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 5849us (8023us total) trans 0 rc 301/301 00000100:00100000:2.0:1782607695.752102:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 139 00000100:00100000:3.0:1782607695.758861:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607695.759013:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342370816 00000100:00100000:2.0:1782607695.759023:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342370816 00000100:00100000:2.0:1782607695.759077:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 140 00000100:00100000:2.0:1782607695.759088:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9744437c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+15:11324:x1869199342370816:12345-192.168.202.4@tcp:36:lfs.0 00010000:00010000:2.0:1782607695.759159:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782607695.759186:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466800/0x8109266df35cb419 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffcda expref: 15 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607695.759205:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff974543e77800) 00010000:00010000:2.0:1782607695.759209:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782607695.759480:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974540030000/0x8109266df35cbab0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607695.759495:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cba71 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe93 expref: 5 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607695.759504:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff974540030000/0x8109266df35cbab0 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607695.759542:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cba71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe93 expref: 5 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607695.759557:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cba71 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe93 expref: 5 pid: 5805 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607695.759571:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457fad7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5803:1869199364401920:192.168.202.4@tcp:104: 00000100:00100000:2.0:1782607695.759677:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff97457f49e240 going to sleep for 11 seconds 00000100:00100000:2.0:1782607695.763010:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457fad7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5803:1869199364401920:192.168.202.4@tcp:104: 00010000:00010000:2.0:1782607695.763040:0:5803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff974540030000/0x8109266df35cbab0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607695.764660:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607695.764733:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342370944 00000100:00100000:0.0:1782607695.764742:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342370944 00010000:00010000:0.0:1782607695.764823:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cba71 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe93 expref: 6 pid: 5805 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607695.764920:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 60 00000100:00100000:0.0:1782607695.764930:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9744437c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d45e125-365f-42d9-9f91-770009f5d4b0+6:2356:x1869199342370944:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782607695.764947:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:3.0:1782607695.764956:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782607695.765323:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cba71 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe93 expref: 6 pid: 5805 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607695.765341:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cba71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe93 expref: 6 pid: 5805 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607695.765363:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cba71 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe93 expref: 6 pid: 5805 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607695.765378:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff974543e77800) 00010000:00010000:0.0:1782607695.765383:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff974540030000/0x8109266df35cbab0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607695.765399:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff974540030000/0x8109266df35cbab0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607695.765406:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974540030000/0x8109266df35cbab0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607695.765447:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782607695.765505:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9744437c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2356:x1869199342370944:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 576us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607695.765513:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 60 00010000:00010000:2.0:1782607695.766651:0:5803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff974540030000/0x8109266df35cbab0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607695.766799:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974540030000/0x8109266df35cbab0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607695.766823:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cbab7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607695.766834:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cbab7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607695.767363:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cbab7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782607695.769946:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1782607695.770182:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974540030000/0x8109266df35cbab0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607695.770200:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974540030000/0x8109266df35cbab0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607695.770207:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974540030000/0x8109266df35cbab0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607695.770214:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974540030000 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607695.770219:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974540030000/0x8109266df35cbab0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607695.770227:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974540030000/0x8109266df35cbab0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607695.770243:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff974543e77800) 00010000:00010000:2.0:1782607695.770246:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607695.770250:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974540030000/0x8109266df35cbab0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607695.770255:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974540030000/0x8109266df35cbab0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782607695.770274:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bcf51e7a reply state 00000000c973071a transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cbab7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607695.770283:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782607695.770387:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9744437c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+16:11324:x1869199342370816:12345-192.168.202.4@tcp:36:lfs.0 Request processed in 11296us (11542us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1782607695.770397:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 140 00010000:00010000:1.0:1782607695.777398:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cbab7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607695.777418:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cbab7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607695.777426:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cbab7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607695.777431:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974540030600 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607695.777437:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cbab7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607695.777457:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cbab7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607695.777474:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9745432c6c00) 00010000:00010000:1.0:1782607695.777478:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607695.777483:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cbab7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607695.777490:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cbab7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607695.871068:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607695.871259:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342371072 00000100:00100000:0.0:1782607695.871271:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342371072 00000100:00100000:0.0:1782607695.871399:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 141 00000100:00100000:0.0:1782607695.871411:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745776b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+15:11332:x1869199342371072:12345-192.168.202.4@tcp:101:lctl.0 00010000:00010000:0.0:1782607695.871438:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607695.871462:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbabe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffea8 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607695.871533:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43800/0x8109266df35cbac5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607695.871547:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43800/0x8109266df35cbac5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607695.871558:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43800/0x8109266df35cbac5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782607695.871620:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782607695.871624:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1782607695.871671:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43800/0x8109266df35cbac5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607695.871698:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbabe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffea8 expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607695.871713:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43800/0x8109266df35cbac5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffea8 expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607695.871721:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97454be19700) 00010000:00010000:0.0:1782607695.871724:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782607695.871728:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c43800, rc 0) 00000100:00100000:0.0:1782607695.871823:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745776b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+16:11332:x1869199342371072:12345-192.168.202.4@tcp:101:lctl.0 Request processed in 414us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607695.871831:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 141 00000100:00100000:2.0:1782607695.922388:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607695.923842:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342371200 00000100:00100000:0.0:1782607695.923853:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342371200 00000100:00100000:0.0:1782607695.923922:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 142 00000100:00100000:0.0:1782607695.923933:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457fad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+16:11338:x1869199342371200:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:0.0:1782607695.923954:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607695.923984:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbacc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffeaf expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607695.924056:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbad3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607695.924072:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbad3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607695.924083:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbad3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607695.924111:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbada lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607695.924133:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbada lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607695.924140:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbada lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607695.924370:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cbae1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607695.924377:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cbae1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607695.924382:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cbae1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782607695.924406:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1782607695.924409:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782607695.924425:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cbae1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607695.924434:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbad3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607695.924438:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbad3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607695.924443:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbad3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607695.924454:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42000 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607695.924457:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbad3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607695.924462:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbad3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607695.924472:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97454be19700) 00010000:00010000:0.0:1782607695.924475:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782607695.924480:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbad3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607695.924485:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbad3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607695.924498:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbada lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607695.924504:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbada lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607695.924510:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbada lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607695.924516:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42600 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607695.924519:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbada lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607695.924525:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbada lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607695.924539:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff97454be19f00) 00010000:00010000:0.0:1782607695.924541:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782607695.924543:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbada lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607695.924546:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbada lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607695.924571:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbacc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffeaf expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607695.924579:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cbae1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffeaf expref: 17 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607695.924583:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97454be19200) 00010000:00010000:0.0:1782607695.924585:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782607695.924586:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c43200, rc 0) 00000100:00100000:0.0:1782607695.925347:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457fad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+17:11338:x1869199342371200:12345-192.168.202.4@tcp:101:bash.0 Request processed in 1414us (2967us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607695.925354:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 142 00000100:00100000:3.0:1782607695.930601:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607695.931405:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342371456 00000100:00100000:2.0:1782607695.931427:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342371456 00000100:00100000:2.0:1782607695.931574:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 143 00000100:00100000:2.0:1782607695.931584:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9744437c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+17:11338:x1869199342371456:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:2.0:1782607695.931604:0:7437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607695.931623:0:7437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974540030000/0x8109266df35cbae8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffeb6 expref: -99 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607695.931840:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cbaef lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607695.931960:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cbaef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607695.931981:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cbaef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607695.932155:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cbaf6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607695.932165:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cbaf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607695.932172:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cbaf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782607695.932951:0:7437:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1782607695.933117:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbafd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607695.933127:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbafd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607695.933136:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbafd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607695.933167:0:7437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cbaef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607695.933174:0:7437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cbaef lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607695.933181:0:7437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cbaef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607695.933187:0:7437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974540030600 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:3.0:1782607695.933191:0:7437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cbaef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607695.933210:0:7437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cbaef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607695.933224:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97454be19200) 00010000:00010000:3.0:1782607695.933227:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782607695.933232:0:7437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cbaef lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607695.933238:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974540030600/0x8109266df35cbaef lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782607695.933252:0:7437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a068e6d1 reply state 000000002b0649e9 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cbaf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607695.933261:0:7437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782607695.933359:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974540030000/0x8109266df35cbae8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffeb6 expref: 20 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607695.933374:0:7437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbafd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffeb6 expref: 19 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607695.933382:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745454f5100) 00010000:00010000:3.0:1782607695.933384:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782607695.933387:0:7437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97455d649400, rc 0) 00000100:00100000:3.0:1782607695.933468:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9744437c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+20:11338:x1869199342371456:12345-192.168.202.4@tcp:101:bash.0 Request processed in 1882us (2875us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1782607695.933477:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 143 00000100:00100000:3.0:1782607695.938969:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607695.939226:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342371584 00000100:00100000:1.0:1782607695.939236:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342371584 00000100:00100000:1.0:1782607695.939311:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 47 00000100:00100000:1.0:1782607695.939322:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9744437c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2354:x1869199342371584:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:1.0:1782607695.939363:0:6609:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607695.939382:0:6609:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a12a26e6/0x8109266df35cbb0b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffebd expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782607695.939408:0:6609:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782607695.939427:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=354s v=(0 0) 00010000:00010000:1.0:1782607695.939431:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607695.939446:0:6609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a12a26e6/0x8109266df35cbb0b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffebd expref: 6 pid: 6609 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607695.939465:0:6609:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a12a26e6/0x8109266df35cbb0b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffebd expref: 6 pid: 6609 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607695.939478:0:6609:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97457f466e00, rc 0) 00000100:00100000:1.0:1782607695.939533:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9744437c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2354:x1869199342371584:12345-192.168.202.4@tcp:101:bash.0 Request processed in 213us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607695.939540:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 47 00000100:00080000:3.0:1782607695.939818:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1782607695.940693:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cbaf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607695.940705:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cbaf6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607695.940713:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cbaf6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607695.940732:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d649c00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607695.940737:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cbaf6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607695.940745:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cbaf6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607695.940760:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9745454f5d00) 00010000:00010000:0.0:1782607695.940776:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782607695.940781:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cbaf6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607695.940787:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cbaf6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607695.945601:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607695.945796:0:9088:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342371712 00000100:00100000:2.0:1782607695.945805:0:9088:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342371712 00000100:00100000:2.0:1782607695.945859:0:9088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 48 00000100:00100000:2.0:1782607695.945870:0:9088:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745776b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:11338:x1869199342371712:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:2.0:1782607695.945888:0:9088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607695.945906:0:9088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049b30c71/0x8109266df35cbb12 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffec4 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607695.945938:0:9088:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a12a26e6/0x8109266df35cbb0b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffebd expref: 7 pid: 6609 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607695.945948:0:9088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782607695.945952:0:9088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782607695.946005:0:9088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049b30c71/0x8109266df35cbb12 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffec4 expref: 7 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607695.946043:0:9088:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a12a26e6/0x8109266df35cbb0b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffebd expref: 7 pid: 6609 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607695.946057:0:9088:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a12a26e6/0x8109266df35cbb0b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffebd expref: 7 pid: 6609 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607695.946072:0:9088:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457fad5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9088:1869199364402048:192.168.202.4@tcp:104: 00000100:00100000:2.0:1782607695.947649:0:9088:0:(client.c:2701:ptlrpc_set_wait()) set ffff97457f49e240 going to sleep for 11 seconds 00000100:00100000:2.0:1782607695.952410:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607695.952533:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342371840 00000100:00100000:3.0:1782607695.952543:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342371840 00010000:00010000:3.0:1782607695.952580:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a12a26e6/0x8109266df35cbb0b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffebd expref: 8 pid: 6609 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607695.952618:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 61 00000100:00100000:3.0:1782607695.952627:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457fad7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+8:2356:x1869199342371840:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782607695.952642:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782607695.952671:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a12a26e6/0x8109266df35cbb0b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffebd expref: 8 pid: 6609 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607695.952684:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a12a26e6/0x8109266df35cbb0b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffebd expref: 8 pid: 6609 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607695.952708:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782607695.952713:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782607695.952722:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000049b30c71/0x8109266df35cbb12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffec4 expref: 8 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607695.952733:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049b30c71/0x8109266df35cbb12 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffec4 expref: 8 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607695.952806:0:5787:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000049b30c71/0x8109266df35cbb12 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffec4 expref: 8 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607695.952819:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9744437c5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5787:1869199364402176:192.168.202.4@tcp:105: 00000100:00100000:3.0:1782607695.952909:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff974442a7c480 going to sleep for 11 seconds 00010000:00010000:1.0:1782607695.953471:0:9088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a12a26e6/0x8109266df35cbb0b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffebd expref: 8 pid: 6609 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607695.953488:0:9088:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457fad5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9088:1869199364402048:192.168.202.4@tcp:104: 00010000:00010000:1.0:1782607695.953512:0:9088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000049b30c71/0x8109266df35cbb12 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffec4 expref: 7 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607695.953535:0:9088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585ada00, rc 0) 00000100:00100000:1.0:1782607695.953577:0:9088:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745776b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:11338:x1869199342371712:12345-192.168.202.4@tcp:101:bash.0 Request processed in 7710us (7985us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607695.953585:0:9088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 48 00000100:00100000:2.0:1782607695.958557:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607695.958646:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342372096 00000100:00100000:0.0:1782607695.958655:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342372096 00000100:00100000:0.0:1782607695.958712:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 36 00000100:00100000:0.0:1782607695.958722:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457fad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+19:11338:x1869199342372096:12345-192.168.202.4@tcp:35:bash.0 00000100:00100000:0.0:1782607695.959172:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457fad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+20:11338:x1869199342372096:12345-192.168.202.4@tcp:35:bash.0 Request processed in 451us (623us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1782607695.959180:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 36 00000100:00100000:3.0:1782607695.959857:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9744437c5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5787:1869199364402176:192.168.202.4@tcp:105: 00010000:00010000:3.0:1782607695.959884:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782607695.959924:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457fad7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2356:x1869199342371840:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 7298us (7523us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607695.959933:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 61 00000100:00100000:2.0:1782607696.063938:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607696.064197:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342372352 00000100:00100000:3.0:1782607696.064207:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342372352 00000100:00100000:3.0:1782607696.064263:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 144 00000100:00100000:3.0:1782607696.064273:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457fad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+20:11348:x1869199342372352:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1782607696.064296:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607696.064315:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649000/0x8109266df35cbb19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffecb expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782607696.064433:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1782607696.064564:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649000/0x8109266df35cbb19 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffecb expref: 22 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607696.064580:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97454be19700) 00010000:00010000:3.0:1782607696.064583:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782607696.064589:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649000/0x8109266df35cbb19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffecb expref: 22 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607696.064601:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97455d649000, rc 0) 00000100:00100000:3.0:1782607696.064959:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457fad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+21:11348:x1869199342372352:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 686us (1027us total) trans 4294967419 rc 301/301 00000100:00100000:3.0:1782607696.064976:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 144 00000100:00100000:0.0:1782607696.070870:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607696.071455:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342372608 00000100:00100000:1.0:1782607696.071467:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342372608 00000100:00100000:1.0:1782607696.071581:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 37 00000100:00100000:1.0:1782607696.071593:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580e51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+21:11348:x1869199342372608:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:1.0:1782607696.072341:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580e51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+22:11348:x1869199342372608:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 747us (1477us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1782607696.072349:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 37 00000100:00100000:1.0:1782607696.129126:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607696.129284:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607696.129680:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342372864 00000100:00100000:3.0:1782607696.129690:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342372864 00000100:00100000:3.0:1782607696.129747:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 49 00000100:00100000:3.0:1782607696.129757:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581538700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2357:x1869199342372864:12345-192.168.202.4@tcp:16:kworker.0 00000100:00100000:3.0:1782607696.129910:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581538700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2357:x1869199342372864:12345-192.168.202.4@tcp:16:kworker.0 Request processed in 145us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607696.129918:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 49 00010000:00010000:3.0:1782607696.131417:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782607696.131840:0:6614:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342372736 00000100:00100000:2.0:1782607696.131956:0:6614:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342372736 00002000:00100000:2.0:1782607696.132012:0:6614:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff974581538e00 x1869199342372736/t0(0) o4->d72d7fb9-639f-4ad9-b658-df715cbf7792@192.168.202.4@tcp:612/0 lens 504/0 e 0 to 0 dl 1782607707 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782607696.132023:0:6614:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974581538e00 with x1869199342372736 ext(0->12) 00002000:00010000:2.0:1782607696.132029:0:6614:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff974581538e00 00000100:00100000:2.0:1782607696.133671:0:6614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4 00000100:00100000:2.0:1782607696.133687:0:6614:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581538e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2356:x1869199342372736:12345-192.168.202.4@tcp:4:bash.0 00000100:00100000:2.0:1782607696.134299:0:6614:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581538e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+8:2356:x1869199342372736:12345-192.168.202.4@tcp:4:bash.0 Request processed in 617us (5181us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1782607696.134307:0:6614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4 00002000:00100000:2.0:1782607696.134316:0:6614:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff974581538e00 x1869199342372736/t4294967305(0) o4->d72d7fb9-639f-4ad9-b658-df715cbf7792@192.168.202.4@tcp:612/0 lens 504/448 e 0 to 0 dl 1782607707 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782607696.134330:0:6614:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974581538e00 with x1869199342372736 ext(0->12) 00002000:00010000:2.0:1782607696.134334:0:6614:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff974581538e00 00000100:00100000:1.0:1782607696.227851:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607696.227987:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342372992 00000100:00100000:0.0:1782607696.227999:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342372992 00000100:00100000:0.0:1782607696.228062:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 145 00000100:00100000:0.0:1782607696.228072:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458153b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+22:11354:x1869199342372992:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1782607696.228124:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607696.228146:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cbb27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffed2 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607696.228209:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cbb2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607696.228223:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cbb2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607696.228235:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cbb2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782607696.228292:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1782607696.228295:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1782607696.228522:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cbb2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607696.228546:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cbb27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffed2 expref: 24 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607696.228564:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cbb2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffed2 expref: 23 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607696.228573:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97454be19200) 00010000:00010000:0.0:1782607696.228575:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782607696.228579:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c43400, rc 0) 00000100:00100000:0.0:1782607696.228634:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458153b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+23:11354:x1869199342372992:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 564us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607696.228640:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 145 00000100:00100000:3.0:1782607696.239616:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607696.239870:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342373248 00000100:00100000:2.0:1782607696.239880:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342373248 00000100:00100000:2.0:1782607696.239943:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 146 00000100:00100000:2.0:1782607696.239954:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9744437c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+23:11354:x1869199342373248:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1782607696.239984:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607696.240134:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cbb35 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffed9 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607696.240243:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbb3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607696.240256:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbb3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607696.240274:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbb3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782607696.240285:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1782607696.240485:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cbb35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffed9 expref: 26 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607696.240508:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbb3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffed9 expref: 25 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607696.240516:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745454f5100) 00010000:00010000:2.0:1782607696.240519:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782607696.240535:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974541548c00, rc 0) 00000100:00100000:2.0:1782607696.240648:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9744437c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+25:11354:x1869199342373248:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 695us (1039us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1782607696.240655:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 146 00000100:00100000:3.0:1782607696.243560:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607696.243645:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342373376 00000100:00100000:0.0:1782607696.243655:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342373376 00000100:00100000:0.0:1782607696.243720:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 10 00000100:00100000:0.0:1782607696.243729:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9744437c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+25:2355:x1869199342373376:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782607696.243746:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782607696.243795:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbb3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffed9 expref: 25 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607696.243811:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745454f5100) 00010000:00010000:0.0:1782607696.243814:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782607696.243873:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9744437c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+24:2355:x1869199342373376:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 144us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607696.243880:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 10 00000100:00100000:1.0:1782607696.247299:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607696.249465:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342373632 00000100:00100000:3.0:1782607696.249478:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342373632 00000100:00100000:3.0:1782607696.249714:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 147 00000100:00100000:3.0:1782607696.249725:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581538380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+24:11354:x1869199342373632:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1782607696.249749:0:7437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607696.249983:0:7437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649000/0x8109266df35cbb4a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffee0 expref: -99 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607696.250082:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbb51 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607696.250164:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbb51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607696.250177:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbb51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782607696.250190:0:7437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1782607696.250432:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649000/0x8109266df35cbb4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffee0 expref: 27 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607696.250466:0:7437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbb51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffee0 expref: 26 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607696.250476:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745454f5100) 00010000:00010000:3.0:1782607696.250479:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1782607696.250483:0:7437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97455d649a00, rc 0) 00000100:00100000:3.0:1782607696.250596:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581538380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+26:11354:x1869199342373632:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 873us (3305us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1782607696.250605:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 147 00000100:00100000:3.0:1782607696.262419:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607696.262807:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342373760 00000100:00100000:0.0:1782607696.262816:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342373760 00000100:00100000:0.0:1782607696.262872:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 50 00000100:00100000:0.0:1782607696.262883:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9744437c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+8:2357:x1869199342373760:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:0.0:1782607696.262931:0:6608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000470c81da/0x8109266df35cbb5f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607696.262953:0:6608:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049b30c71/0x8109266df35cbb12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffec4 expref: 8 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607696.262971:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1782607696.262975:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782607696.262979:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000470c81da/0x8109266df35cbb5f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607696.263049:0:6608:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049b30c71/0x8109266df35cbb12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffec4 expref: 8 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607696.263065:0:6608:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049b30c71/0x8109266df35cbb12 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffec4 expref: 8 pid: 9088 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607696.263080:0:6608:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580e53480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6608:1869199364402304:192.168.202.4@tcp:104: 00000100:00100000:0.0:1782607696.263525:0:6608:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745442e2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782607696.266426:0:6608:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580e53480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6608:1869199364402304:192.168.202.4@tcp:104: 00010000:00010000:2.0:1782607696.266458:0:6608:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000470c81da/0x8109266df35cbb5f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607696.267213:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607696.267315:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342373888 00000100:00100000:2.0:1782607696.267320:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342373888 00010000:00010000:2.0:1782607696.267356:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000049b30c71/0x8109266df35cbb12 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffec4 expref: 9 pid: 9088 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607696.267384:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 62 00000100:00100000:2.0:1782607696.267390:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9744437c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+9:2357:x1869199342373888:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782607696.267402:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1782607696.267418:0:5787:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1782607696.267419:0:5787:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1782607696 00002000:00010000:2.0:1782607696.267421:0:5787:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1782607696 00010000:00010000:2.0:1782607696.267425:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000049b30c71/0x8109266df35cbb12 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffec4 expref: 9 pid: 9088 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607696.267441:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000049b30c71/0x8109266df35cbb12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffec4 expref: 9 pid: 9088 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607696.267461:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049b30c71/0x8109266df35cbb12 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffec4 expref: 9 pid: 9088 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607696.267495:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782607696.267499:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782607696.267506:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000470c81da/0x8109266df35cbb5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607696.267517:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000470c81da/0x8109266df35cbb5f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607696.267543:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782607696.267586:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9744437c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+8:2357:x1869199342373888:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 195us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607696.267591:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 62 00010000:00010000:3.0:1782607696.267649:0:6608:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000470c81da/0x8109266df35cbb5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607696.267669:0:6608:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000470c81da/0x8109266df35cbb5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607696.267694:0:6608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000470c81da/0x8109266df35cbb5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607696.267700:0:6608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000470c81da/0x8109266df35cbb5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607696.267705:0:6608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000470c81da/0x8109266df35cbb5f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607696.267722:0:6608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42200 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:3.0:1782607696.267727:0:6608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000470c81da/0x8109266df35cbb5f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607696.267736:0:6608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000470c81da/0x8109266df35cbb5f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607696.267748:0:6608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000470c81da/0x8109266df35cbb5f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607696.267757:0:6608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000470c81da/0x8109266df35cbb5f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607696.267836:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9744437c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:2357:x1869199342373760:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 4956us (5429us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607696.267849:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 50 00000100:00100000:3.0:1782607696.270937:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607696.271154:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342374144 00000100:00100000:2.0:1782607696.271162:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342374144 00000100:00100000:2.0:1782607696.271225:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 38 00000100:00100000:2.0:1782607696.271237:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549b89050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+26:11354:x1869199342374144:12345-192.168.202.4@tcp:35:lfs.0 00000004:00010000:2.0:1782607696.271294:0:5807:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbb51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffee0 expref: 26 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782607696.271544:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1782607696.271575:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1782607696.272404:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1782607696.272992:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff974541549200/0x8109266df35cbb66 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607696.273090:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbafd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffeb6 expref: 30 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607696.273104:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff974541549200/0x8109266df35cbb66 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607696.273144:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbafd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffeb6 expref: 30 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607696.273154:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbafd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffeb6 expref: 30 pid: 7437 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607696.273165:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f4b4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5807:1869199364402432:192.168.202.4@tcp:104: 00000100:00100000:2.0:1782607696.273496:0:5807:0:(client.c:2701:ptlrpc_set_wait()) set ffff97457f49ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782607696.288631:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607696.289555:0:5807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f4b4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5807:1869199364402432:192.168.202.4@tcp:104: 00010000:00010000:2.0:1782607696.289583:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff974541549200/0x8109266df35cbb66 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607696.293547:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342374272 00000100:00100000:3.0:1782607696.293561:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342374272 00010000:00010000:3.0:1782607696.293608:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbafd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffeb6 expref: 31 pid: 7437 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607696.293835:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 63 00000100:00100000:2.0:1782607696.293857:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581539c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+31:2356:x1869199342374272:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782607696.293879:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782607696.293887:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbafd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffeb6 expref: 31 pid: 7437 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607696.293902:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbafd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffeb6 expref: 31 pid: 7437 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607696.293926:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbafd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffeb6 expref: 31 pid: 7437 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607696.293956:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745454f5100) 00010000:00010000:2.0:1782607696.293971:0:5787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff974541549200/0x8109266df35cbb66 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607696.293981:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff974541549200/0x8109266df35cbb66 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607696.293989:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974541549200/0x8109266df35cbb66 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607696.294032:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782607696.294092:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581539c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+30:2356:x1869199342374272:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 248us (5473us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607696.294097:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 63 00010000:00010000:0.0:1782607696.294221:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff974541549200/0x8109266df35cbb66 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607696.294229:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541549200/0x8109266df35cbb66 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782607696.294370:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1782607696.294596:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1782607696.294738:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580e53480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5807:1869199364402560:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1782607696.294880:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607696.294908:0:5807:0:(client.c:2701:ptlrpc_set_wait()) set ffff97458124aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1782607696.295378:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364402560 00000100:00100000:1.0:1782607696.295384:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364402560 00000100:00100000:1.0:1782607696.295447:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782607696.295456:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580c05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5807:x1869199364402560:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1782607696.295532:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580c05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5807:x1869199364402560:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 77us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607696.295539:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782607696.296630:0:5807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580e53480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5807:1869199364402560:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1782607696.297618:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1782607696.299263:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580c06300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5807:1869199364402688:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1782607696.299330:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607696.299354:0:5807:0:(client.c:2701:ptlrpc_set_wait()) set ffff97457f923f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782607696.299513:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364402688 00000100:00100000:1.0:1782607696.299530:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364402688 00000100:00100000:1.0:1782607696.299573:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782607696.299580:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580c07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5807:x1869199364402688:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1782607696.300104:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580c07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5807:x1869199364402688:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 523us (774us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1782607696.300111:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782607696.300185:0:5807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580c06300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5807:1869199364402688:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1782607696.300259:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1782607696.300301:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff974541549200/0x8109266df35cbb66 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607696.300312:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974541549200/0x8109266df35cbb66 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607696.300320:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974541549200/0x8109266df35cbb66 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607696.300327:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974541549200 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607696.300332:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541549200/0x8109266df35cbb66 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607696.300347:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541549200/0x8109266df35cbb66 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607696.300360:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745454f5100) 00010000:00010000:2.0:1782607696.300363:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1782607696.300366:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974541549200/0x8109266df35cbb66 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607696.300370:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541549200/0x8109266df35cbb66 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782607696.300566:0:5807:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1782607696.300693:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1782607696.300701:0:5807:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 355146935684ns, next at 356146934319ns, rc = 0 00000001:00080000:2.0:1782607696.300706:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1782607696.300735:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745454f5100) 00010000:00010000:2.0:1782607696.300738:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1782607696.300745:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbb51 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffee0 expref: 34 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607696.301102:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549b89050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+33:11354:x1869199342374144:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 29868us (30174us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1782607696.301108:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 38 00000020:00080000:2.0:1782607696.301112:0:5807:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1782607696.303411:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607696.303483:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342374400 00000100:00100000:2.0:1782607696.303493:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342374400 00000100:00100000:2.0:1782607696.303537:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 148 00000100:00100000:2.0:1782607696.303544:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458153ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+33:11354:x1869199342374400:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1782607696.303577:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607696.303605:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541548400/0x8109266df35cbb6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffee7 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607696.303672:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974541548400/0x8109266df35cbb6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffee7 expref: 34 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607696.303685:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548400/0x8109266df35cbb6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffee7 expref: 34 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607696.303700:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745432c6600) 00010000:00010000:2.0:1782607696.303702:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782607696.303704:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974541548400, rc 0) 00000100:00100000:2.0:1782607696.303757:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458153ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+34:11354:x1869199342374400:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 212us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607696.303790:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 148 00000100:00100000:1.0:1782607696.309100:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607696.309239:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342374656 00000100:00100000:0.0:1782607696.309260:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342374656 00000100:00100000:0.0:1782607696.309314:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 39 00000100:00100000:0.0:1782607696.309325:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458153aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+34:11354:x1869199342374656:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:0.0:1782607696.309557:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458153aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+35:11354:x1869199342374656:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 234us (465us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1782607696.309563:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 39 00000100:00100000:1.0:1782607696.438650:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607696.439973:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342374912 00000100:00100000:0.0:1782607696.439987:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342374912 00000100:00100000:0.0:1782607696.440069:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 149 00000100:00100000:0.0:1782607696.440078:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974567325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+35:11364:x1869199342374912:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1782607696.440104:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607696.440122:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbb74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffeee expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782607696.440280:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1782607696.440432:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbb74 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffeee expref: 37 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607696.440445:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97454be19700) 00010000:00010000:0.0:1782607696.440447:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782607696.440450:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbb74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffeee expref: 37 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607696.441076:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c42200, rc 0) 00000100:00100000:0.0:1782607696.441151:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974567325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+36:11364:x1869199342374912:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 1069us (2508us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1782607696.441156:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 149 00000100:00100000:1.0:1782607696.458189:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607696.458235:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342375040 00000100:00100000:1.0:1782607696.458245:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342375040 00000100:00100000:1.0:1782607696.458311:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 150 00000100:00100000:1.0:1782607696.458322:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974567327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+36:11364:x1869199342375040:12345-192.168.202.4@tcp:34:lfs.0 00010000:00010000:1.0:1782607696.458414:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cbb82 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607696.458431:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cbb82 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607696.458453:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cbb82 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607696.458580:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cbb89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607696.458590:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cbb89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607696.458597:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cbb89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607696.459149:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466000/0x8109266df35cbb90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607696.459159:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466000/0x8109266df35cbb90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607696.459166:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466000/0x8109266df35cbb90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782607696.459209:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466000/0x8109266df35cbb90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607696.459222:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cbb82 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607696.459228:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cbb82 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607696.459235:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cbb82 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607696.459241:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f467c00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607696.459244:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cbb82 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607696.459250:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cbb82 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607696.459260:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97454be19200) 00010000:00010000:1.0:1782607696.459263:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607696.459278:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cbb82 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607696.459293:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cbb82 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607696.459308:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cbb89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607696.459314:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cbb89 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607696.459320:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cbb89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607696.459325:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f466c00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607696.459328:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cbb89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607696.459334:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cbb89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607696.459342:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff974543e77700) 00010000:00010000:1.0:1782607696.459345:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607696.459348:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cbb89 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607696.459354:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cbb89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607696.459367:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466000/0x8109266df35cbb90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607696.459373:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466000/0x8109266df35cbb90 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607696.459385:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466000/0x8109266df35cbb90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607696.459389:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f466000 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607696.459392:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466000/0x8109266df35cbb90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607696.459398:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466000/0x8109266df35cbb90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607696.459406:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745432c6600) 00010000:00010000:1.0:1782607696.459408:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607696.459411:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466000/0x8109266df35cbb90 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607696.459416:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466000/0x8109266df35cbb90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607696.461606:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974567327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+36:11364:x1869199342375040:12345-192.168.202.4@tcp:34:lfs.0 Request processed in 3277us (3418us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607696.461619:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 150 00000100:00100000:1.0:1782607696.474352:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607696.474792:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342375296 00000100:00100000:3.0:1782607696.474802:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342375296 00000100:00100000:3.0:1782607696.474852:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 40 00000100:00100000:3.0:1782607696.474863:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974567324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+36:11364:x1869199342375296:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:3.0:1782607696.475117:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974567324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+37:11364:x1869199342375296:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 256us (774us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1782607696.475123:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 40 00000001:00080000:3.0:1782607696.552926:0:7525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:3.0:1782607696.552947:0:7525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:0.0:1782607696.556895:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607696.557007:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342375552 00000100:00100000:3.0:1782607696.557021:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342375552 00000100:00100000:3.0:1782607696.557103:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 151 00000100:00100000:3.0:1782607696.557115:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580e51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+37:11367:x1869199342375552:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1782607696.557151:0:7437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607696.557181:0:7437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649000/0x8109266df35cbb97 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffef5 expref: -99 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607696.557286:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbb9e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607696.557305:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbb9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607696.557319:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbb9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607696.557338:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cbba5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607696.557346:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cbba5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607696.557353:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cbba5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607696.557538:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbbac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607696.557548:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbbac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607696.557555:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbbac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782607696.557566:0:7437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1782607696.557675:0:7437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbb9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607696.557680:0:7437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbb9e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607696.557686:0:7437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbb9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607696.557690:0:7437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d649e00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:3.0:1782607696.557693:0:7437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbb9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607696.557699:0:7437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbb9e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607696.557710:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97454be19200) 00010000:00010000:3.0:1782607696.557712:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782607696.557715:0:7437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbb9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607696.557726:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbb9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607696.557738:0:7437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cbba5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607696.557741:0:7437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cbba5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607696.557745:0:7437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cbba5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607696.557748:0:7437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d649600 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:3.0:1782607696.557750:0:7437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cbba5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607696.557753:0:7437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cbba5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607696.557757:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9745454f5600) 00010000:00010000:3.0:1782607696.557758:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782607696.557760:0:7437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cbba5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607696.557814:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cbba5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607696.557868:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649000/0x8109266df35cbb97 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffef5 expref: 40 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607696.557883:0:7437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbbac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffef5 expref: 39 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607696.557898:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745432c6600) 00010000:00010000:3.0:1782607696.557900:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782607696.557904:0:7437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97455d649a00, rc 0) 00000100:00100000:3.0:1782607696.557984:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580e51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+39:11367:x1869199342375552:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 871us (1106us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1782607696.557993:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 151 00000100:00100000:1.0:1782607696.561417:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607696.561559:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342375680 00000100:00100000:0.0:1782607696.561574:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342375680 00000100:00100000:0.0:1782607696.561660:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 152 00000100:00100000:0.0:1782607696.561673:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974567324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+39:11367:x1869199342375680:12345-192.168.202.4@tcp:54:lfs.0 00010000:00010000:0.0:1782607696.561823:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbbba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607696.561858:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbbba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607696.561872:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbbba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607696.561910:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbbba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607696.561917:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbbba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607696.561925:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbbba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607696.561932:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42200 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607696.561936:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbbba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607696.561945:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbbba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607696.561971:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745432c6600) 00010000:00010000:0.0:1782607696.561975:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782607696.562000:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbbba lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607696.562007:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbbba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607696.562121:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974567324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+39:11367:x1869199342375680:12345-192.168.202.4@tcp:54:lfs.0 Request processed in 449us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607696.562130:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 152 00000100:00100000:1.0:1782607696.573946:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607696.574244:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342375936 00000100:00100000:3.0:1782607696.574257:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342375936 00000100:00100000:3.0:1782607696.574325:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 41 00000100:00100000:3.0:1782607696.574336:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974567326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+39:11367:x1869199342375936:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:3.0:1782607696.574724:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974567326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+40:11367:x1869199342375936:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 389us (793us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1782607696.574733:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 41 00000100:00100000:2.0:1782607697.084490:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607697.084639:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342376192 00000100:00100000:3.0:1782607697.084653:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342376192 00000100:00100000:3.0:1782607697.084840:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 153 00000100:00100000:3.0:1782607697.084856:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+40:11398:x1869199342376192:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:3.0:1782607697.084892:0:7437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607697.084923:0:7437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649000/0x8109266df35cbbc1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffefc expref: -99 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.085067:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cbbc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.085088:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cbbc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.085128:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cbbc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782607697.085144:0:7437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1782607697.085600:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649000/0x8109266df35cbbc1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffefc expref: 43 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.085626:0:7437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cbbc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffefc expref: 42 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.085637:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745432c6600) 00010000:00010000:3.0:1782607697.085641:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782607697.085645:0:7437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97455d649600, rc 0) 00000100:00100000:3.0:1782607697.085856:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+42:11398:x1869199342376192:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1004us (1381us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1782607697.085865:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 153 00000100:00080000:0.0:1782607697.086050:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782607697.092213:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607697.092329:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342376448 00000100:00100000:2.0:1782607697.092352:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342376448 00000100:00100000:2.0:1782607697.092465:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 42 00000100:00100000:2.0:1782607697.092478:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455d460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+42:11398:x1869199342376448:12345-192.168.202.4@tcp:35:cat.0 00000100:00100000:2.0:1782607697.093081:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455d460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+43:11398:x1869199342376448:12345-192.168.202.4@tcp:35:cat.0 Request processed in 603us (882us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1782607697.093090:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 42 00000100:00100000:2.0:1782607697.099690:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607697.106036:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342376576 00000100:00100000:0.0:1782607697.106050:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342376576 00000100:00100000:0.0:1782607697.106134:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11 00000100:00100000:0.0:1782607697.106146:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+43:2355:x1869199342376576:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782607697.106164:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782607697.106192:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cbbc8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffefc expref: 43 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607697.106214:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745432c6600) 00010000:00010000:0.0:1782607697.106219:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782607697.106290:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+42:2355:x1869199342376576:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 145us (6608us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607697.106298:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11 00000100:00100000:0.0:1782607697.128919:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607697.128968:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607697.129004:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607697.129142:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342376960 00000100:00100000:1.0:1782607697.129152:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342376960 00000100:00100000:1.0:1782607697.129218:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 160 00000100:00100000:1.0:1782607697.129227:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974548948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2357:x1869199342376960:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1782607697.129311:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974548948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2357:x1869199342376960:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 84us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607697.129319:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 160 00000100:00100000:2.0:1782607697.129633:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342376704 00000100:00100000:2.0:1782607697.129643:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342376704 00000100:00100000:2.0:1782607697.129678:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 298 00000100:00100000:2.0:1782607697.129685:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2357:x1869199342376704:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607697.129716:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2357:x1869199342376704:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 32us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607697.129723:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 298 00000100:00100000:3.0:1782607697.129945:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342376832 00000100:00100000:3.0:1782607697.129950:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342376832 00000100:00100000:3.0:1782607697.129994:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 97 00000100:00100000:3.0:1782607697.130002:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580e53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2356:x1869199342376832:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1782607697.130043:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580e53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2356:x1869199342376832:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 42us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607697.130050:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 97 00000100:00080000:0.0:1782607697.130459:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782607697.130465:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782607697.154072:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607697.157009:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607697.157156:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342377216 00000100:00100000:3.0:1782607697.157165:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342377216 00000100:00100000:3.0:1782607697.157251:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 154 00000100:00100000:3.0:1782607697.157262:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455d460380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+42:11404:x1869199342377216:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:3.0:1782607697.157300:0:7437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607697.157304:0:7437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1782607697.157328:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cbb2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffed2 expref: 42 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.157348:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97454be19200) 00010000:00010000:3.0:1782607697.157353:0:7437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782607697.157365:0:7437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649000/0x8109266df35cbbd6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629fff03 expref: -99 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.157478:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbbdd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.157492:0:7437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbbac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffef5 expref: 42 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.157502:0:7437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbbdd lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.157534:0:7437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbbac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffef5 expref: 42 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.157548:0:7437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbbac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffef5 expref: 42 pid: 7437 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607697.157561:0:7437:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9744437c4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7437:1869199364402816:192.168.202.4@tcp:104: 00000100:00100000:3.0:1782607697.157666:0:7437:0:(client.c:2701:ptlrpc_set_wait()) set ffff974442a7c840 going to sleep for 11 seconds 00000100:00100000:3.0:1782607697.160233:0:7437:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9744437c4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7437:1869199364402816:192.168.202.4@tcp:104: 00010000:00010000:3.0:1782607697.160289:0:7437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbbdd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607697.161496:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607697.161565:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342377344 00000100:00100000:3.0:1782607697.161574:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342377344 00010000:00010000:3.0:1782607697.161616:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbbac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffef5 expref: 43 pid: 7437 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607697.161655:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 64 00000100:00100000:3.0:1782607697.161663:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455109fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+43:2357:x1869199342377344:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782607697.161679:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782607697.161686:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbbac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffef5 expref: 43 pid: 7437 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.161699:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbbac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffef5 expref: 43 pid: 7437 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.161721:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbbac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffef5 expref: 43 pid: 7437 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.161738:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745432c6600) 00010000:00010000:3.0:1782607697.161743:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbbdd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.161751:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbbdd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.161759:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbbdd lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.161852:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782607697.161897:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455109fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+42:2357:x1869199342377344:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 235us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607697.161911:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 64 00010000:00010000:1.0:1782607697.162288:0:7437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbbdd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607697.162297:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbbdd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782607697.162316:0:7437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1782607697.162488:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649000/0x8109266df35cbbd6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff03 expref: 43 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607697.162505:0:7437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbbdd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff03 expref: 42 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607697.162513:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745432c6600) 00010000:00010000:1.0:1782607697.162516:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782607697.162518:0:7437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97455d649e00, rc 0) 00000100:00100000:1.0:1782607697.162557:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455d460380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+42:11404:x1869199342377216:12345-192.168.202.4@tcp:101:dd.0 Request processed in 5298us (5558us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1782607697.162565:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 154 00000100:00100000:2.0:1782607697.168142:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607697.168235:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342377600 00000100:00100000:1.0:1782607697.168245:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342377600 00000100:00100000:1.0:1782607697.168296:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 155 00000100:00100000:1.0:1782607697.168305:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+42:11404:x1869199342377600:12345-192.168.202.4@tcp:36:dd.0 00010000:00010000:1.0:1782607697.169246:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cbbeb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607697.169264:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cbbeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607697.169276:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cbbeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782607697.169331:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:1.0:1782607697.169352:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006bbfe77c reply state 00000000ead937bd transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cbbeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607697.169362:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782607697.169568:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+45:11404:x1869199342377600:12345-192.168.202.4@tcp:36:dd.0 Request processed in 1262us (1435us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1782607697.169577:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 155 00000020:00080000:1.0:1782607697.169582:0:5804:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1782607697.180372:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cbbeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607697.180390:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cbbeb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607697.180398:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cbbeb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607697.180404:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f467200 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607697.180409:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cbbeb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607697.180416:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cbbeb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607697.180458:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745432c6600) 00010000:00010000:1.0:1782607697.180461:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607697.180465:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cbbeb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607697.180480:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cbbeb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607697.473326:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607697.474135:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342377728 00000100:00100000:1.0:1782607697.474146:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342377728 00000100:00100000:1.0:1782607697.474212:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 156 00000100:00100000:1.0:1782607697.474222:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9744437c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+44:11418:x1869199342377728:12345-192.168.202.4@tcp:101:stat.0 00010000:00010000:1.0:1782607697.474245:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607697.474266:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cbbf2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629fff0a expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607697.474346:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cbbf9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607697.474360:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cbbf9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607697.474371:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cbbf9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607697.474385:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cbc00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607697.474392:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cbc00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607697.474415:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cbc00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607697.474515:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cbc07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607697.474526:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbbdd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff03 expref: 45 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607697.474534:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cbc07 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607697.474567:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbbdd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff03 expref: 45 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607697.474580:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbbdd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff03 expref: 45 pid: 7437 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607697.474594:0:5805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d461180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1869199364402944:192.168.202.4@tcp:104: 00000100:00100000:1.0:1782607697.474702:0:5805:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745510dd6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782607697.484289:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607697.484362:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342377984 00000100:00100000:3.0:1782607697.484374:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342377984 00000100:00100000:3.0:1782607697.484441:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 43 00000100:00100000:3.0:1782607697.484452:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+46:5568:x1869199342377984:12345-192.168.202.4@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1782607697.485014:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+47:5568:x1869199342377984:12345-192.168.202.4@tcp:35:ldlm_bl.0 Request processed in 562us (735us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1782607697.485023:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 43 00000100:00100000:1.0:1782607697.485149:0:5805:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d461180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1869199364402944:192.168.202.4@tcp:104: 00010000:00010000:1.0:1782607697.485176:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cbc07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607697.493650:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607697.493714:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342378112 00000100:00100000:3.0:1782607697.493724:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342378112 00010000:00010000:3.0:1782607697.493788:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbbdd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff03 expref: 47 pid: 7437 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607697.493830:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 65 00000100:00100000:3.0:1782607697.493848:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+47:2355:x1869199342378112:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782607697.493865:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782607697.493873:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbbdd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff03 expref: 47 pid: 7437 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.493889:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbbdd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff03 expref: 47 pid: 7437 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.493931:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbbdd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff03 expref: 47 pid: 7437 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.493947:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745432c6600) 00010000:00010000:3.0:1782607697.493964:0:5787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cbc07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.493974:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cbc07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.493982:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cbc07 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.494022:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782607697.494089:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cbc07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607697.494097:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cbc07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782607697.494141:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1782607697.494144:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782607697.494158:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cbc07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607697.494168:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cbc07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607697.494175:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cbbf9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607697.494180:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cbbf9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607697.494184:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cbbf9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607697.494188:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f467600 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607697.494191:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cbbf9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607697.494195:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cbbf9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607697.494202:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97454be19200) 00010000:00010000:1.0:1782607697.494204:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607697.494206:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cbbf9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607697.494210:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cbbf9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607697.494225:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cbc00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607697.494231:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cbc00 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607697.494237:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cbc00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607697.494243:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f467c00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607697.494246:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cbc00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607697.494251:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cbc00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607697.494260:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff974543e77500) 00010000:00010000:1.0:1782607697.494262:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607697.494265:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cbc00 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607697.494271:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cbc00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607697.494309:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cbbf2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff0a expref: 47 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607697.494310:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+47:2355:x1869199342378112:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 469us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607697.494324:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 65 00010000:00010000:1.0:1782607697.494337:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cbc07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff0a expref: 46 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607697.494351:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745432c6600) 00010000:00010000:1.0:1782607697.494352:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782607697.494354:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97457f466c00, rc 0) 00000100:00100000:1.0:1782607697.494375:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9744437c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+45:11418:x1869199342377728:12345-192.168.202.4@tcp:101:stat.0 Request processed in 20157us (21061us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607697.494380:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 156 00000100:00100000:0.0:1782607697.582644:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607697.582807:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342378368 00000100:00100000:2.0:1782607697.582822:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342378368 00000100:00100000:2.0:1782607697.583046:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 157 00000100:00100000:2.0:1782607697.583058:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97454894b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+45:11424:x1869199342378368:12345-192.168.202.4@tcp:36:truncate.0 00010000:00010000:2.0:1782607697.583117:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782607697.583143:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466c00/0x8109266df35cbc07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff0a expref: 45 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607697.583164:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745432c6600) 00010000:00010000:2.0:1782607697.583169:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782607697.583370:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbc0e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607697.583385:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbc0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607697.583395:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbc0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782607697.583481:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1782607697.583506:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000487007f7 reply state 00000000ac4510a3 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbc0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607697.583515:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782607697.583632:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97454894b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+47:11424:x1869199342378368:12345-192.168.202.4@tcp:36:truncate.0 Request processed in 576us (1011us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1782607697.583640:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 157 00000020:00080000:2.0:1782607697.583645:0:5803:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1782607697.587553:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbc0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607697.587568:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbc0e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607697.587574:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbc0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607697.587578:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974541548c00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607697.587582:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbc0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607697.587587:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbc0e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607697.587600:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745432c6600) 00010000:00010000:0.0:1782607697.587602:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782607697.587605:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbc0e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607697.587608:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbc0e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607697.793029:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607697.794044:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342378496 00000100:00100000:3.0:1782607697.794062:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342378496 00000100:00100000:3.0:1782607697.794154:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 158 00000100:00100000:3.0:1782607697.794168:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97454894ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+46:11438:x1869199342378496:12345-192.168.202.4@tcp:101:stat.0 00010000:00010000:3.0:1782607697.794203:0:7437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607697.794232:0:7437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbc15 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629fff11 expref: -99 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.794338:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbc1c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.794381:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbc1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.794397:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbc1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.794417:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbc23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.794437:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbc23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.794446:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbc23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.794578:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cbc2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.794589:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cbc2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.794597:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cbc2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782607697.794642:0:7437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1782607697.794647:0:7437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782607697.794678:0:7437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cbc2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.794693:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cbc2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.794715:0:7437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbc1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.794723:0:7437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbc1c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.794731:0:7437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbc1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.794738:0:7437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d649a00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:3.0:1782607697.794744:0:7437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbc1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.794753:0:7437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbc1c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.794823:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97454be19200) 00010000:00010000:3.0:1782607697.794827:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782607697.794845:0:7437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbc1c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.794853:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbc1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.794869:0:7437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbc23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.794876:0:7437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbc23 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.794882:0:7437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbc23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.794894:0:7437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d649400 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:3.0:1782607697.794898:0:7437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbc23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.794905:0:7437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbc23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.794914:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9745454f5600) 00010000:00010000:3.0:1782607697.794917:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782607697.794920:0:7437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbc23 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.794926:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbc23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.794979:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbc15 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff11 expref: 48 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.794996:0:7437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cbc2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff11 expref: 47 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607697.795004:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745432c6600) 00010000:00010000:3.0:1782607697.795007:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782607697.795010:0:7437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97455d649c00, rc 0) 00000100:00100000:3.0:1782607697.795105:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97454894ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+47:11438:x1869199342378496:12345-192.168.202.4@tcp:101:stat.0 Request processed in 939us (2086us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607697.795114:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 158 00000100:00100000:2.0:1782607697.921971:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607697.922063:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342378752 00000100:00100000:1.0:1782607697.922080:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342378752 00000100:00100000:1.0:1782607697.922161:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 159 00000100:00100000:1.0:1782607697.922176:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745776b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+47:11448:x1869199342378752:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1782607697.922206:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607697.922234:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cbc31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629fff18 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782607697.922576:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1782607697.922739:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cbc31 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff18 expref: 49 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607697.922758:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97454be19700) 00010000:00010000:1.0:1782607697.922762:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782607697.922804:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cbc31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff18 expref: 49 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607697.922822:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97457f467200, rc 0) 00000100:00100000:1.0:1782607697.923055:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745776b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+48:11448:x1869199342378752:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 881us (1229us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1782607697.923086:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 159 00000100:00100000:0.0:1782607697.927192:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607697.927819:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342379008 00000100:00100000:3.0:1782607697.928052:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342379008 00000100:00100000:2.0:1782607697.928203:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 44 00000100:00100000:2.0:1782607697.928216:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549b8b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+48:11448:x1869199342379008:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:2.0:1782607697.929225:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549b8b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+49:11448:x1869199342379008:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 1005us (2044us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1782607697.929236:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 44 00000004:00080000:1.0:1782607697.987224:0:7892:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 356833454274ns, next at 357833450744ns, rc = 0 00000100:00100000:3.0:1782607697.987312:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364403072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782607697.987432:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607697.987650:0:6613:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364403072 00000100:00100000:1.0:1782607697.987661:0:6613:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364403072 00000100:00100000:1.0:1782607697.987737:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1782607697.987749:0:6613:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9744437c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364403072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782607697.987823:0:6613:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782607697.987888:0:6613:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9744437c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364403072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 141us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607697.987895:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1782607697.988125:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782607697.988163:0:3317:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:3.0:1782607697.988171:0:3317:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:3.0:1782607697.988203:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364403072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782607698.103537:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607698.103634:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342379264 00000100:00100000:3.0:1782607698.103644:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342379264 00000100:00100000:3.0:1782607698.103705:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 160 00000100:00100000:3.0:1782607698.103715:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974548949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+49:11454:x1869199342379264:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:3.0:1782607698.103739:0:7437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607698.103759:0:7437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbc3f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629fff1f expref: -99 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.104040:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbc46 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.104124:0:7437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cbc2a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff11 expref: 50 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.104134:0:7437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbc46 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.104172:0:7437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cbc2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff11 expref: 50 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.104185:0:7437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cbc2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff11 expref: 50 pid: 7437 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607698.104218:0:7437:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9744437c7800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7437:1869199364403200:192.168.202.4@tcp:104: 00000100:00100000:3.0:1782607698.104444:0:7437:0:(client.c:2701:ptlrpc_set_wait()) set ffff974442a7c6c0 going to sleep for 11 seconds 00000001:00080000:3.0:1782607698.105747:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967433 is committed 00000020:00080000:3.0:1782607698.105803:0:5825:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97457f923840 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1782607698.105808:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff974571513100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97457f9233c0 00000020:00080000:3.0:1782607698.105812:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff974571513700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97457f369000 00000020:00080000:2.0:1782607698.105900:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1782607698.106130:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:3.0:1782607698.106219:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967445 is committed 00000001:00080000:3.0:1782607698.106237:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967446 is committed 00000004:00080000:3.0:1782607698.106250:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000100:00100000:3.0:1782607698.107198:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364403328:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782607698.107261:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607698.108165:0:9088:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364403328 00000100:00100000:1.0:1782607698.108174:0:9088:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364403328 00000100:00100000:1.0:1782607698.108233:0:9088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1782607698.108243:0:9088:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9744437c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364403328:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782607698.108274:0:9088:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:1.0:1782607698.108308:0:9088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a406f50, atime: 0x0, ctime: 0x6a406f50, blocks: 0xb 00010000:00010000:1.0:1782607698.108317:0:9088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b27fd35/0x8109266df35cbc4d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607698.108334:0:9088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=356s v=(0 0) 00010000:00010000:1.0:1782607698.108339:0:9088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607698.108345:0:9088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b27fd35/0x8109266df35cbc4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607698.108364:0:9088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b27fd35/0x8109266df35cbc4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607698.108398:0:9088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b27fd35/0x8109266df35cbc4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607698.108406:0:9088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b27fd35/0x8109266df35cbc4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607698.108438:0:9088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782607698.109306:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782607698.109314:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b27fd35/0x8109266df35cbc4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607698.109325:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f467200 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:2.0:1782607698.109329:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b27fd35/0x8109266df35cbc4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607698.109339:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b27fd35/0x8109266df35cbc4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607698.109364:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b27fd35/0x8109266df35cbc4d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607698.109372:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b27fd35/0x8109266df35cbc4d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607698.109392:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607698.109393:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607698.109395:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607698.109434:0:9088:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9744437c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3318:x1869199364403328:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1191us (2171us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1782607698.109443:0:9088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000004:00080000:3.0:1782607698.111250:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97455d461180/2, rc 0, transno 4294967307 00000100:00100000:3.0:1782607698.111262:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364403328:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782607698.114568:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607698.114672:0:7437:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9744437c7800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7437:1869199364403200:192.168.202.4@tcp:104: 00010000:00010000:3.0:1782607698.114707:0:7437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbc46 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607698.114808:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342379392 00000100:00100000:1.0:1782607698.114816:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342379392 00010000:00010000:1.0:1782607698.114852:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cbc2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff11 expref: 19 pid: 7437 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607698.114884:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 66 00000100:00100000:1.0:1782607698.114893:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974548949500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+19:2356:x1869199342379392:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782607698.114907:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782607698.114913:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cbc2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff11 expref: 19 pid: 7437 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607698.114924:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cbc2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff11 expref: 19 pid: 7437 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607698.114957:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649c00/0x8109266df35cbc2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff11 expref: 19 pid: 7437 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607698.114987:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745432c6600) 00010000:00010000:1.0:1782607698.114991:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbc46 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607698.115001:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbc46 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607698.115009:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbc46 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607698.115039:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782607698.115088:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974548949500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+18:2356:x1869199342379392:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 196us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607698.115096:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 66 00010000:00010000:3.0:1782607698.115156:0:7437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbc46 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.115163:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbc46 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782607698.115183:0:7437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1782607698.115855:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbc3f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff1f expref: 19 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.115883:0:7437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbc46 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff1f expref: 18 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.115890:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745432c6600) 00010000:00010000:3.0:1782607698.115892:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782607698.115895:0:7437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97455d649400, rc 0) 00000100:00100000:3.0:1782607698.115928:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974548949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+18:11454:x1869199342379264:12345-192.168.202.4@tcp:101:bash.0 Request processed in 12215us (12402us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1782607698.115935:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 160 00000100:00100000:2.0:1782607698.119568:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607698.119660:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342379648 00000100:00100000:1.0:1782607698.119669:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342379648 00000100:00100000:1.0:1782607698.119728:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 161 00000100:00100000:1.0:1782607698.119738:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974567324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+18:11454:x1869199342379648:12345-192.168.202.4@tcp:36:bash.0 00010000:00010000:1.0:1782607698.120248:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cbc5b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607698.120266:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cbc5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607698.120277:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cbc5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782607698.120335:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1782607698.120360:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006c5a6506 reply state 0000000069abb9c0 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cbc5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607698.120382:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782607698.121023:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974567324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+21:11454:x1869199342379648:12345-192.168.202.4@tcp:36:bash.0 Request processed in 1283us (1460us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1782607698.121032:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 161 00000020:00080000:1.0:1782607698.121038:0:5803:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782607698.130296:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cbc5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.130315:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cbc5b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.130321:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cbc5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.130327:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f467c00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:3.0:1782607698.130332:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cbc5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.130340:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cbc5b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.130357:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745432c6600) 00010000:00010000:3.0:1782607698.130360:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782607698.130365:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cbc5b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.130386:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cbc5b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607698.141643:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607698.141989:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342379776 00000100:00100000:1.0:1782607698.142000:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342379776 00000100:00100000:1.0:1782607698.142065:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 162 00000100:00100000:1.0:1782607698.142075:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974567326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+20:11454:x1869199342379776:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:1.0:1782607698.142103:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607698.142125:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cbc62 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629fff26 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607698.142207:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466000/0x8109266df35cbc69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607698.142223:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbc46 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff1f expref: 21 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607698.142232:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466000/0x8109266df35cbc69 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607698.142267:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbc46 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff1f expref: 21 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607698.142281:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbc46 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff1f expref: 21 pid: 7437 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607698.142315:0:5805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d460000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1869199364403456:192.168.202.4@tcp:104: 00000100:00100000:1.0:1782607698.142394:0:5805:0:(client.c:2701:ptlrpc_set_wait()) set ffff974543d79540 going to sleep for 11 seconds 00000100:00100000:0.0:1782607698.145162:0:5805:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d460000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1869199364403456:192.168.202.4@tcp:104: 00010000:00010000:0.0:1782607698.145191:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466000/0x8109266df35cbc69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607698.145882:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607698.146103:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342379904 00000100:00100000:3.0:1782607698.146110:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342379904 00010000:00010000:3.0:1782607698.146149:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbc46 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff1f expref: 22 pid: 7437 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607698.146187:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 67 00000100:00100000:3.0:1782607698.146197:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+22:2357:x1869199342379904:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782607698.146212:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782607698.146219:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbc46 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff1f expref: 22 pid: 7437 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.146231:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbc46 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff1f expref: 22 pid: 7437 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.146253:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbc46 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff1f expref: 22 pid: 7437 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.146268:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745432c6600) 00010000:00010000:3.0:1782607698.146273:0:5787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466000/0x8109266df35cbc69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.146283:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466000/0x8109266df35cbc69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.146290:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466000/0x8109266df35cbc69 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.146321:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782607698.146379:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+21:2357:x1869199342379904:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 182us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607698.146387:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 67 00010000:00010000:0.0:1782607698.146738:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466000/0x8109266df35cbc69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.146747:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466000/0x8109266df35cbc69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782607698.147091:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1782607698.147097:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782607698.147122:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466000/0x8109266df35cbc69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607698.147155:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cbc62 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff26 expref: 21 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607698.147172:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466000/0x8109266df35cbc69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff26 expref: 20 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607698.147181:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745432c6600) 00010000:00010000:2.0:1782607698.147184:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782607698.147186:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97457f466000, rc 0) 00000100:00100000:2.0:1782607698.147230:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974567326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+20:11454:x1869199342379776:12345-192.168.202.4@tcp:101:bash.0 Request processed in 5156us (5598us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607698.147248:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 162 00000100:00100000:2.0:1782607698.157483:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607698.157577:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342380160 00000100:00100000:0.0:1782607698.157588:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342380160 00000100:00100000:0.0:1782607698.157651:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 45 00000100:00100000:0.0:1782607698.157662:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457fad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+20:11454:x1869199342380160:12345-192.168.202.4@tcp:35:bash.0 00000100:00100000:0.0:1782607698.157954:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457fad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+21:11454:x1869199342380160:12345-192.168.202.4@tcp:35:bash.0 Request processed in 284us (473us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1782607698.157963:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 45 00010000:00010000:3.0:1782607698.178075:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607698.329427:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607698.329537:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342380416 00000100:00100000:0.0:1782607698.329547:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342380416 00000100:00100000:0.0:1782607698.329606:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 163 00000100:00100000:0.0:1782607698.329617:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455d460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+21:11464:x1869199342380416:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1782607698.329643:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607698.329672:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbc70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629fff2d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782607698.329983:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1782607698.330159:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbc70 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff2d expref: 23 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.330174:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97454be19700) 00010000:00010000:0.0:1782607698.330183:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782607698.330189:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbc70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff2d expref: 23 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.330202:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c42000, rc 0) 00000100:00100000:0.0:1782607698.330264:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455d460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+22:11464:x1869199342380416:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 649us (848us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1782607698.330272:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 163 00000100:00100000:1.0:1782607698.335711:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607698.335968:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342380544 00000100:00100000:3.0:1782607698.335978:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342380544 00000100:00100000:3.0:1782607698.336262:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 164 00000100:00100000:3.0:1782607698.336274:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974578da9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+22:11464:x1869199342380544:12345-192.168.202.4@tcp:34:lfs.0 00010000:00010000:3.0:1782607698.336368:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbc7e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.336388:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbc7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.336400:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbc7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.336416:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbc85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.336424:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbc85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.336432:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbc85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.338872:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbc8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.338902:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbc8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.338914:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbc8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782607698.338978:0:7437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbc8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.338991:0:7437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbc7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.338998:0:7437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbc7e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.339005:0:7437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbc7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.339011:0:7437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d649400 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:3.0:1782607698.339015:0:7437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbc7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.339023:0:7437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbc7e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.339035:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97454be19200) 00010000:00010000:3.0:1782607698.339038:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782607698.339043:0:7437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbc7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.339058:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbc7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.339080:0:7437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbc85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.339086:0:7437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbc85 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.339093:0:7437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbc85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.339098:0:7437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d649e00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:3.0:1782607698.339101:0:7437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbc85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.339107:0:7437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbc85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.339115:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9745454f5600) 00010000:00010000:3.0:1782607698.339118:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782607698.339122:0:7437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbc85 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.339127:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbc85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.339142:0:7437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbc8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.339149:0:7437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbc8c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.339154:0:7437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbc8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.339167:0:7437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d649a00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:3.0:1782607698.339170:0:7437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbc8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.339175:0:7437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbc8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.339183:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745432c6600) 00010000:00010000:3.0:1782607698.339185:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782607698.339188:0:7437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbc8c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.339193:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbc8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607698.339302:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974578da9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+22:11464:x1869199342380544:12345-192.168.202.4@tcp:34:lfs.0 Request processed in 3025us (3658us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607698.339313:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 164 00000100:00100000:0.0:1782607698.351424:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607698.351549:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342380800 00000100:00100000:2.0:1782607698.351560:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342380800 00000100:00100000:2.0:1782607698.351618:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 46 00000100:00100000:2.0:1782607698.351630:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97454894b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+22:11464:x1869199342380800:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:2.0:1782607698.352668:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97454894b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+23:11464:x1869199342380800:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 1036us (1249us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1782607698.352678:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 46 00000100:00100000:1.0:1782607698.433858:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607698.434176:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342381056 00000100:00100000:0.0:1782607698.434187:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342381056 00000100:00100000:0.0:1782607698.434247:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 165 00000100:00100000:0.0:1782607698.434259:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457718f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+23:11467:x1869199342381056:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1782607698.434289:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607698.434312:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbc93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629fff34 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.434405:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cbc9a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.434431:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cbc9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.434442:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cbc9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.434459:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbca1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.434466:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbca1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.434486:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbca1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.435303:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cbca8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.435316:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cbca8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.435324:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cbca8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782607698.435511:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1782607698.435619:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cbc9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.435628:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cbc9a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.435635:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cbc9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.435641:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42a00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607698.435647:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cbc9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.435655:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cbc9a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.435669:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97454be19200) 00010000:00010000:0.0:1782607698.435673:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782607698.435685:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cbc9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.435691:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cbc9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.435705:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbca1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.435712:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbca1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.435718:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbca1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.435722:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42200 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607698.435725:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbca1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.435731:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbca1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.435740:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97454be19f00) 00010000:00010000:0.0:1782607698.435742:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782607698.435745:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbca1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.435751:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbca1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.436020:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbc93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff34 expref: 26 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.436115:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cbca8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff34 expref: 25 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.436125:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745432c6600) 00010000:00010000:0.0:1782607698.436127:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782607698.436130:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c43400, rc 0) 00000100:00100000:0.0:1782607698.436209:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457718f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+25:11467:x1869199342381056:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 1952us (2361us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1782607698.436218:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 165 00000100:00100000:1.0:1782607698.440623:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607698.440732:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342381184 00000100:00100000:3.0:1782607698.440749:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342381184 00000100:00100000:1.0:1782607698.440821:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607698.440886:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 166 00000100:00100000:3.0:1782607698.440902:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457718fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+25:11467:x1869199342381184:12345-192.168.202.4@tcp:54:lfs.0 00000100:00100000:0.0:1782607698.440952:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342381312 00000100:00100000:0.0:1782607698.440963:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342381312 00010000:00010000:3.0:1782607698.441014:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbcb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607698.441032:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 12 00010000:00010000:3.0:1782607698.441037:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbcb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607698.441053:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457718f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+26:2355:x1869199342381312:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782607698.441064:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbcb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.441072:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782607698.441098:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cbca8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff34 expref: 26 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.441138:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745432c6600) 00010000:00010000:0.0:1782607698.441143:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782607698.441156:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbcb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.441167:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbcb6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.441176:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbcb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.441183:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d649a00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:3.0:1782607698.441189:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbcb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.441200:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbcb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607698.441201:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457718f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+25:2355:x1869199342381312:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 154us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607698.441226:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 12 00010000:00010000:3.0:1782607698.441233:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745432c6600) 00010000:00010000:3.0:1782607698.441240:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782607698.441245:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbcb6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.441252:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbcb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607698.441331:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457718fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+24:11467:x1869199342381184:12345-192.168.202.4@tcp:54:lfs.0 Request processed in 433us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607698.441339:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 166 00000100:00100000:1.0:1782607698.446884:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607698.447970:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342381568 00000100:00100000:2.0:1782607698.447989:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342381568 00000100:00100000:2.0:1782607698.448085:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 47 00000100:00100000:2.0:1782607698.448104:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457718df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+24:11467:x1869199342381568:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:2.0:1782607698.448474:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457718df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+25:11467:x1869199342381568:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 376us (1605us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1782607698.448484:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 47 00000100:00100000:1.0:1782607698.651034:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607698.651225:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342381824 00000100:00100000:2.0:1782607698.651240:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342381824 00000100:00100000:2.0:1782607698.651329:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 167 00000100:00100000:2.0:1782607698.651342:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457718c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+25:11485:x1869199342381824:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1782607698.651376:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607698.651405:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbcbd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629fff3b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607698.651565:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbcc4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607698.651608:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbcc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607698.651625:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbcc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782607698.651643:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1782607698.651850:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbcbd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff3b expref: 28 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607698.651876:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbcc4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff3b expref: 27 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607698.651888:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745432c6600) 00010000:00010000:2.0:1782607698.651892:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1782607698.651897:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974541548e00, rc 0) 00000100:00100000:2.0:1782607698.652004:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457718c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+27:11485:x1869199342381824:12345-192.168.202.4@tcp:101:cat.0 Request processed in 663us (985us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1782607698.652013:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 167 00000100:00100000:1.0:1782607698.697566:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607698.697753:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342381952 00000100:00100000:3.0:1782607698.697796:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342381952 00000100:00100000:3.0:1782607698.697887:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 168 00000100:00100000:3.0:1782607698.697919:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457718ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+27:11486:x1869199342381952:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1782607698.697964:0:7437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607698.697990:0:7437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbcd2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629fff42 expref: -99 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.698085:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbcd9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.698102:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbcd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.698116:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbcd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782607698.698376:0:7437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1782607698.698381:0:7437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1782607698.698484:0:7437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbcd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.698518:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbcd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff42 expref: 29 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.698540:0:7437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbcd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff42 expref: 28 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607698.698552:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97454be19200) 00010000:00010000:3.0:1782607698.698555:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782607698.698559:0:7437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97455d649e00, rc 0) 00000100:00100000:3.0:1782607698.698640:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457718ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+28:11486:x1869199342381952:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 724us (1089us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607698.698657:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 168 00000100:00100000:1.0:1782607698.708357:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607698.709203:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342382336 00000100:00100000:0.0:1782607698.709221:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342382336 00000100:00100000:0.0:1782607698.709307:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 48 00000100:00100000:0.0:1782607698.709338:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745509ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+28:11486:x1869199342382336:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:0.0:1782607698.710584:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745509ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+29:11486:x1869199342382336:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 1238us (2233us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1782607698.710601:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 48 00000100:00100000:1.0:1782607698.716316:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607698.717293:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342382464 00000100:00100000:0.0:1782607698.717309:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342382464 00000100:00100000:0.0:1782607698.717494:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 13 00000100:00100000:0.0:1782607698.717508:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745509eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+29:11486:x1869199342382464:12345-192.168.202.4@tcp:103:lfs.0 00010000:00010000:0.0:1782607698.717529:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1782607698.717561:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466000/0x8109266df35cbc69 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff26 expref: 29 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.717588:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbcc4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff3b expref: 28 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.717604:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541548400/0x8109266df35cbb6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffee7 expref: 27 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.717615:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745432c6600) 00010000:00010000:0.0:1782607698.717641:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782607698.717726:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745509eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+26:11486:x1869199342382464:12345-192.168.202.4@tcp:103:lfs.0 Request processed in 221us (1424us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607698.717735:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 13 00000100:00100000:1.0:1782607698.723919:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607698.724148:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342382592 00000100:00100000:2.0:1782607698.724161:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342382592 00000100:00100000:2.0:1782607698.724234:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 169 00000100:00100000:2.0:1782607698.724247:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745509eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+26:11486:x1869199342382592:12345-192.168.202.4@tcp:58:lfs.0 00010000:00010000:2.0:1782607698.724576:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbce0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607698.724599:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbce0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607698.724625:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbce0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782607698.726353:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1782607698.727333:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745509eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+26:11486:x1869199342382592:12345-192.168.202.4@tcp:58:lfs.0 Request processed in 3078us (3419us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607698.727351:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 169 00000100:00100000:1.0:1782607698.756970:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607698.758014:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342382720 00000100:00100000:0.0:1782607698.758029:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342382720 00000100:00100000:0.0:1782607698.758121:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 170 00000100:00100000:0.0:1782607698.758135:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745509ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+26:11488:x1869199342382720:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1782607698.758184:0:7437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607698.758211:0:7437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cbce7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629fff49 expref: -99 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.758304:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbcee lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.758320:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbcee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.758332:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbcee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.758347:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbcf5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.758354:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbcf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.758360:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbcf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.760294:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cbcfc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.760317:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cbcfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.760331:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cbcfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782607698.760393:0:7437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1782607698.760409:0:7437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782607698.760452:0:7437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cbcfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.760479:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cbcfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.760489:0:7437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbcee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.760496:0:7437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbcee lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.760504:0:7437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbcee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.760511:0:7437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42000 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607698.760516:0:7437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbcee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.760525:0:7437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbcee lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.760540:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97454be19200) 00010000:00010000:0.0:1782607698.760543:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782607698.760548:0:7437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbcee lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.760555:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbcee lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.760570:0:7437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbcf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.760586:0:7437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbcf5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.760593:0:7437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbcf5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.760598:0:7437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42200 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607698.760602:0:7437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbcf5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.760608:0:7437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbcf5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.760617:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97454be19f00) 00010000:00010000:0.0:1782607698.760620:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782607698.760623:0:7437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbcf5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.760629:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbcf5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.760683:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cbce7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff49 expref: 28 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.760702:0:7437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cbcfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff49 expref: 27 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607698.760711:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745432c6b00) 00010000:00010000:0.0:1782607698.760713:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782607698.760722:0:7437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c42a00, rc 0) 00000100:00100000:0.0:1782607698.763120:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745509ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+27:11488:x1869199342382720:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 4971us (6150us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607698.763135:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 170 00000100:00100000:0.0:1782607699.010346:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782607699.010383:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97454894bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364403584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782607699.010503:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607699.010590:0:6613:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364403584 00000100:00100000:0.0:1782607699.010600:0:6613:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364403584 00000100:00100000:0.0:1782607699.010674:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1782607699.010686:0:6613:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974541321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364403584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782607699.010738:0:6613:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782607699.010816:0:6613:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974541321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364403584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607699.010824:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1782607699.010848:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782607699.011258:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97454894bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364403584:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782607699.220035:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782607699.337497:0:11563:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782607699.337510:0:11563:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782607699.337555:0:11563:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1782607699.337564:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782607699.337720:0:11563:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745509edc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11563:1869199364403712:192.168.202.4@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1782607699.337873:0:11563:0:(client.c:2701:ptlrpc_set_wait()) set ffff974543d796c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782607699.343062:0:11563:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745509edc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11563:1869199364403712:192.168.202.4@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1782607699.352385:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607699.355355:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342382848 00000100:00100000:3.0:1782607699.355375:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342382848 00000100:00100000:2.0:1782607699.364488:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 171 00000100:00100000:2.0:1782607699.364508:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457fad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+27:11499:x1869199342382848:12345-192.168.202.4@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1782607699.364557:0:5804:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1782607699.364717:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457fad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+27:11499:x1869199342382848:12345-192.168.202.4@tcp:53:lhsmtool_posix.0 Request processed in 214us (12345us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607699.364725:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 171 00000100:00080000:3.0:1782607699.366302:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782607699.379358:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607699.379533:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342382976 00000100:00100000:3.0:1782607699.379546:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342382976 00000100:00100000:3.0:1782607699.379627:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 172 00000100:00100000:3.0:1782607699.379640:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745509edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+27:11499:x1869199342382976:12345-192.168.202.4@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1782607699.379741:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbd03 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.379795:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbd03 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.379811:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbd03 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.379873:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbd0a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.379881:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbd0a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.379888:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbd0a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.379923:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cbd11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.379944:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cbd11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.379968:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cbd11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782607699.380020:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1782607699.380025:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782607699.380040:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cbd11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.380054:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbd03 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.380061:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbd03 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.380067:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbd03 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.380073:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d649a00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:3.0:1782607699.380253:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbd03 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.380265:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbd03 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.380282:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97454c8e3f00) 00010000:00010000:3.0:1782607699.380285:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782607699.380291:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbd03 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.380298:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbd03 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.380325:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbd0a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.380332:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbd0a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.380338:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbd0a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.380344:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d649400 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:3.0:1782607699.380348:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbd0a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.380354:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbd0a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.380362:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9745454f5600) 00010000:00010000:3.0:1782607699.380365:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782607699.380368:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbd0a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.380374:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbd0a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.380394:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cbd11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.380401:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cbd11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.380407:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cbd11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.380420:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d648e00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:3.0:1782607699.380424:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cbd11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.380431:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cbd11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.380440:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745432c6b00) 00010000:00010000:3.0:1782607699.380443:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782607699.380446:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cbd11 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.380452:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cbd11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607699.380603:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745509edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+27:11499:x1869199342382976:12345-192.168.202.4@tcp:34:lhsmtool_posix.0 Request processed in 963us (1257us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607699.380614:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 172 00000100:00100000:0.0:1782607699.392895:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607699.393056:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342383232 00000100:00100000:1.0:1782607699.393069:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342383232 00000100:00100000:1.0:1782607699.393156:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 173 00000100:00100000:1.0:1782607699.393167:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974541322a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+27:11499:x1869199342383232:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782607699.393219:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607699.393246:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cbd18 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629fff50 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.393381:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cbd1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.393400:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cbd1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.393415:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cbd1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782607699.393430:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1782607699.393557:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cbd1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.393566:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cbd1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.393574:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cbd1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.393580:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f466a00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607699.393585:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cbd1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.393592:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cbd1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.393607:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745432c6b00) 00010000:00010000:1.0:1782607699.393617:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782607699.393623:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cbd1f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.393629:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cbd1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.393678:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cbd18 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff50 expref: 29 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.393689:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97454c8e3f00) 00010000:00010000:1.0:1782607699.393691:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782607699.393695:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cbd18 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff50 expref: 29 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.393705:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97457f467e00, rc 0) 00000100:00100000:1.0:1782607699.393812:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974541322a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+28:11499:x1869199342383232:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 Request processed in 646us (929us total) trans 4294967457 rc 301/301 00000100:00100000:1.0:1782607699.393820:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 173 00000100:00100000:0.0:1782607699.398258:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607699.398357:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342383360 00000100:00100000:3.0:1782607699.398370:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342383360 00000100:00100000:3.0:1782607699.398443:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 174 00000100:00100000:3.0:1782607699.398455:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974541320000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+28:11499:x1869199342383360:12345-192.168.202.4@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1782607699.398505:0:7437:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1782607699.398646:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974541320000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+28:11499:x1869199342383360:12345-192.168.202.4@tcp:53:lhsmtool_posix.0 Request processed in 193us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607699.398654:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 174 00000100:00100000:1.0:1782607699.413382:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607699.417511:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342383616 00000100:00100000:2.0:1782607699.417532:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342383616 00000100:00100000:2.0:1782607699.417708:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 175 00000100:00100000:2.0:1782607699.417721:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974551140380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+28:11499:x1869199342383616:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782607699.417750:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607699.417754:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1782607699.417808:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cbcd9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff42 expref: 28 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607699.417845:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97454be19200) 00010000:00010000:2.0:1782607699.417869:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782607699.417893:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbd2d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629fff57 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782607699.418907:0:5804:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1782607699.419218:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974541549200/0x8109266df35cbd34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607699.419238:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974541549200/0x8109266df35cbd34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607699.419251:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541549200/0x8109266df35cbd34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607699.419319:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbd2d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff57 expref: 30 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607699.419340:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974541549200/0x8109266df35cbd34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff57 expref: 29 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607699.419350:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9745432c6f00) 00010000:00010000:2.0:1782607699.419353:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782607699.419356:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974541549200, rc 0) 00000100:00100000:2.0:1782607699.419452:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974551140380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+29:11499:x1869199342383616:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 Request processed in 1734us (6084us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1782607699.419461:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 175 00000100:00100000:1.0:1782607699.434142:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607699.434196:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342383872 00000100:00100000:1.0:1782607699.434207:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342383872 00000100:00100000:1.0:1782607699.434273:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 176 00000100:00100000:1.0:1782607699.434284:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974551143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+29:11499:x1869199342383872:12345-192.168.202.4@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782607699.434368:0:7437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782607699.434402:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541549200/0x8109266df35cbd34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff57 expref: 29 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.434467:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9745432c6f00) 00010000:00010000:1.0:1782607699.434491:0:7437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782607699.434520:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cbd42 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.434535:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cbd42 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.434547:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cbd42 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.434564:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cbd49 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xa27d56a2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.434584:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cbd49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa27d56a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.434591:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cbd49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa27d56a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.434967:0:7437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cbd42 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.434977:0:7437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cbd42 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.434984:0:7437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cbd42 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.434990:0:7437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f467e00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607699.434995:0:7437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cbd42 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.435010:0:7437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cbd42 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.435021:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97454be19200) 00010000:00010000:1.0:1782607699.435024:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607699.435028:0:7437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cbd42 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.435035:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cbd42 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.435046:0:7437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cbd49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa27d56a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.435052:0:7437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cbd49 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa27d56a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.435057:0:7437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cbd49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa27d56a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.435062:0:7437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f466a00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607699.435065:0:7437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cbd49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa27d56a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.435070:0:7437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cbd49 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa27d56a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.435077:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xa27d56a2 (ffff974543e77700) 00010000:00010000:1.0:1782607699.435079:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607699.435082:0:7437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cbd49 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa27d56a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.435098:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cbd49 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa27d56a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607699.435203:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974551143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+28:11499:x1869199342383872:12345-192.168.202.4@tcp:36:lhsmtool_posix.0 Request processed in 918us (1073us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782607699.435213:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 176 00000100:00100000:3.0:1782607699.440734:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607699.440815:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342384000 00000100:00100000:3.0:1782607699.440847:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342384000 00000100:00100000:3.0:1782607699.440923:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 177 00000100:00100000:3.0:1782607699.440948:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9744437c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+28:11499:x1869199342384000:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782607699.440979:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607699.441009:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cbd50 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629fff5e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.445212:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbd57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.445244:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbd57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.445260:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbd57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.445420:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cbd50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff5e expref: 30 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.445445:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbd57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff5e expref: 29 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.445457:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9745454f5600) 00010000:00010000:3.0:1782607699.445462:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1782607699.445466:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97455d649400, rc 0) 00000100:00100000:3.0:1782607699.445568:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9744437c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+29:11499:x1869199342384000:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 Request processed in 4631us (4848us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607699.445578:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 177 00000100:00100000:0.0:1782607699.462825:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607699.464444:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342384256 00000100:00100000:3.0:1782607699.464497:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342384256 00000100:00100000:3.0:1782607699.464633:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 178 00000100:00100000:3.0:1782607699.464646:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97454894bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+29:11499:x1869199342384256:12345-192.168.202.4@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782607699.464755:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cbd5e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.464988:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cbd5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.465003:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cbd5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782607699.467063:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1782607699.467082:0:5805:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 358313316632ns, next at 359313312761ns, rc = 0 00000004:00010000:3.0:1782607699.467211:0:5805:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c0b9a5a6 reply state 00000000aac65b65 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cbd5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607699.467226:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782607699.467447:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97454894bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+31:11499:x1869199342384256:12345-192.168.202.4@tcp:36:lhsmtool_posix.0 Request processed in 2799us (4632us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1782607699.467458:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 178 00010000:00010000:0.0:1782607699.480739:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cbd5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.480801:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cbd5e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.480811:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cbd5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.482915:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d648e00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607699.482924:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cbd5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.482944:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cbd5e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.482970:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9745454f5600) 00010000:00010000:0.0:1782607699.482973:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782607699.482979:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cbd5e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.482988:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648e00/0x8109266df35cbd5e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607699.490440:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607699.492038:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342384384 00000100:00100000:3.0:1782607699.492056:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342384384 00000100:00100000:3.0:1782607699.492170:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 179 00000100:00100000:3.0:1782607699.492184:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974551143100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+30:11499:x1869199342384384:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782607699.492221:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607699.492250:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbd65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629fff65 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.492354:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbd65 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff65 expref: 31 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.492375:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbd65 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff65 expref: 31 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.492401:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9745454f5600) 00010000:00010000:3.0:1782607699.492405:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782607699.492410:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97455d649a00, rc 0) 00000100:00100000:3.0:1782607699.492499:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974551143100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+31:11499:x1869199342384384:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 Request processed in 318us (2073us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607699.492507:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 179 00000100:00100000:3.0:1782607699.500146:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607699.500220:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342384512 00000100:00100000:2.0:1782607699.500235:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342384512 00000100:00100000:2.0:1782607699.500333:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 52 00000100:00100000:2.0:1782607699.500346:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9744437c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2356:x1869199342384512:12345-192.168.202.4@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1782607699.500462:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782607699.501083:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9744437c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:2356:x1869199342384512:12345-192.168.202.4@tcp:2:lhsmtool_posix.0 Request processed in 727us (941us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1782607699.501099:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 52 00000100:00100000:0.0:1782607699.508650:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607699.508727:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342384768 00000100:00100000:3.0:1782607699.508742:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342384768 00000100:00100000:3.0:1782607699.508844:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 49 00000100:00100000:3.0:1782607699.508857:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+31:11499:x1869199342384768:12345-192.168.202.4@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1782607699.509201:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+32:11499:x1869199342384768:12345-192.168.202.4@tcp:35:lhsmtool_posix.0 Request processed in 346us (564us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1782607699.509210:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 49 00000100:00100000:0.0:1782607699.516340:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607699.516392:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342385024 00000100:00100000:0.0:1782607699.516406:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342385024 00000100:00100000:0.0:1782607699.516484:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 180 00000100:00100000:0.0:1782607699.516497:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458100a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+32:11499:x1869199342385024:12345-192.168.202.4@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1782607699.516647:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458100a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+32:11499:x1869199342385024:12345-192.168.202.4@tcp:57:lhsmtool_posix.0 Request processed in 153us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607699.516655:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 180 00000100:00100000:3.0:1782607699.519624:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607699.519756:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342385152 00000100:00100000:2.0:1782607699.519796:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342385152 00000100:00100000:2.0:1782607699.520155:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 181 00000100:00100000:2.0:1782607699.520171:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9744437c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+32:11499:x1869199342385152:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782607699.520201:0:7437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607699.520229:0:7437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbd6c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629fff6c expref: -99 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607699.520329:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbd73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607699.520348:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbd73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607699.520361:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbd73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782607699.520409:0:7437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782607699.520432:0:7437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbd73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607699.520464:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbd6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff6c expref: 34 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607699.520486:0:7437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbd73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff6c expref: 33 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607699.520526:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9745454f5600) 00010000:00010000:2.0:1782607699.520529:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1782607699.520534:0:7437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974541549a00, rc 0) 00000100:00100000:2.0:1782607699.520630:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9744437c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+33:11499:x1869199342385152:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 Request processed in 464us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607699.529305:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607699.531011:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 181 00000100:00100000:3.0:1782607699.531129:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342385280 00000100:00100000:3.0:1782607699.531142:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342385280 00000100:00100000:3.0:1782607699.531218:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 53 00000100:00100000:3.0:1782607699.531230:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581009880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:2356:x1869199342385280:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782607699.531267:0:6608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607699.531296:0:6608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b7c6f56/0x8109266df35cbd7a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629fff73 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782607699.531334:0:6608:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a406f54, blocks: 0x1 00010000:00010000:3.0:1782607699.531358:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=358s v=(0 0) 00010000:00010000:3.0:1782607699.531363:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782607699.531374:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b7c6f56/0x8109266df35cbd7a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff73 expref: 8 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.531395:0:6608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006b7c6f56/0x8109266df35cbd7a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff73 expref: 8 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.531411:0:6608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97455d648200, rc 0) 00000100:00100000:3.0:1782607699.531505:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581009880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+8:2356:x1869199342385280:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 Request processed in 276us (2211us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607699.531512:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 53 00000100:00100000:0.0:1782607699.536093:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607699.536278:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342385536 00000100:00100000:2.0:1782607699.536291:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342385536 00000100:00100000:2.0:1782607699.536358:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 182 00000100:00100000:2.0:1782607699.536369:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+33:11499:x1869199342385536:12345-192.168.202.4@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1782607699.536512:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+33:11499:x1869199342385536:12345-192.168.202.4@tcp:57:lhsmtool_posix.0 Request processed in 144us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607699.536521:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 182 00000100:00100000:2.0:1782607699.547998:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607699.548138:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342385664 00000100:00100000:1.0:1782607699.548153:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342385664 00000100:00100000:1.0:1782607699.548228:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 54 00000100:00100000:1.0:1782607699.548242:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457fad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+8:11499:x1869199342385664:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782607699.548269:0:6609:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607699.548294:0:6609:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ef4849e/0x8109266df35cbd81 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629fff7a expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.548336:0:6609:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006b7c6f56/0x8109266df35cbd7a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff73 expref: 9 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.548347:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607699.548352:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607699.548357:0:6609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ef4849e/0x8109266df35cbd81 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff7a expref: 9 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.548403:0:6609:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006b7c6f56/0x8109266df35cbd7a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff73 expref: 9 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.548442:0:6609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006b7c6f56/0x8109266df35cbd7a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff73 expref: 9 pid: 6608 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607699.548460:0:6609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974551140a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6609:1869199364403840:192.168.202.4@tcp:104: 00000100:00100000:1.0:1782607699.548589:0:6609:0:(client.c:2701:ptlrpc_set_wait()) set ffff974543d799c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782607699.560692:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607699.560748:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342385792 00000100:00100000:0.0:1782607699.560789:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342385792 00010000:00010000:0.0:1782607699.560845:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006b7c6f56/0x8109266df35cbd7a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff73 expref: 10 pid: 6608 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607699.561183:0:6609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974551140a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6609:1869199364403840:192.168.202.4@tcp:104: 00010000:00010000:1.0:1782607699.561226:0:6609:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006ef4849e/0x8109266df35cbd81 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff7a expref: 10 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.561250:0:6609:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97457f467600, rc 0) 00000100:00100000:1.0:1782607699.561331:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457fad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+10:11499:x1869199342385664:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 Request processed in 13092us (13348us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607699.561340:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 54 00000100:00100000:0.0:1782607699.562266:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 68 00000100:00100000:0.0:1782607699.562285:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581008700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+9:2356:x1869199342385792:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782607699.562306:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782607699.562339:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006b7c6f56/0x8109266df35cbd7a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff73 expref: 9 pid: 6608 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.562357:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006b7c6f56/0x8109266df35cbd7a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff73 expref: 9 pid: 6608 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.562388:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b7c6f56/0x8109266df35cbd7a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff73 expref: 9 pid: 6608 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.562406:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607699.562411:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607699.562421:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006ef4849e/0x8109266df35cbd81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff7a expref: 8 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.562435:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ef4849e/0x8109266df35cbd81 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff7a expref: 8 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.562488:0:5787:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006ef4849e/0x8109266df35cbd81 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff7a expref: 8 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607699.562530:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676e8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5787:1869199364403968:192.168.202.4@tcp:105: 00000100:00100000:0.0:1782607699.562637:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff97454719a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782607699.574744:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607699.574913:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676e8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5787:1869199364403968:192.168.202.4@tcp:105: 00010000:00010000:0.0:1782607699.574977:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782607699.575059:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581008700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+8:2356:x1869199342385792:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 12781us (14382us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607699.575073:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 68 00000100:00100000:2.0:1782607699.575119:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342385920 00000100:00100000:2.0:1782607699.575130:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342385920 00002000:00100000:2.0:1782607699.575192:0:6616:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff974551140a80 x1869199342385920/t0(0) o4->d72d7fb9-639f-4ad9-b658-df715cbf7792@192.168.202.4@tcp:615/0 lens 504/0 e 0 to 0 dl 1782607710 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782607699.575204:0:6616:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974551140a80 with x1869199342385920 ext(0->8) 00002000:00010000:2.0:1782607699.575210:0:6616:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974551140a80 00000100:00100000:2.0:1782607699.575242:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5 00000100:00100000:2.0:1782607699.575252:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974551140a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+8:2357:x1869199342385920:12345-192.168.202.4@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1782607699.577786:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974551140a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+10:2357:x1869199342385920:12345-192.168.202.4@tcp:4:lhsmtool_posix.0 Request processed in 2140us (2658us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1782607699.577822:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5 00002000:00100000:2.0:1782607699.577835:0:6616:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff974551140a80 x1869199342385920/t4294967314(0) o4->d72d7fb9-639f-4ad9-b658-df715cbf7792@192.168.202.4@tcp:615/0 lens 504/448 e 0 to 0 dl 1782607710 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782607699.577846:0:6616:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974551140a80 with x1869199342385920 ext(0->8) 00002000:00010000:2.0:1782607699.577853:0:6616:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974551140a80 00000100:00100000:1.0:1782607699.588534:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607699.588585:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342386048 00000100:00100000:1.0:1782607699.588598:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342386048 00000100:00100000:1.0:1782607699.588699:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 183 00000100:00100000:1.0:1782607699.588712:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+33:11499:x1869199342386048:12345-192.168.202.4@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1782607699.666248:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000001:00080000:3.0:1782607699.666486:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967457 is committed 00000004:00080000:3.0:1782607699.666503:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000001:00080000:3.0:1782607699.666518:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000020:00080000:3.0:1782607699.666546:0:5825:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:3.0:1782607699.666562:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:3.0:1782607699.666571:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:2.0:1782607699.667871:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1782607699.667889:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1782607699.671833:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+20:11499:x1869199342386048:12345-192.168.202.4@tcp:44:lhsmtool_posix.0 Request processed in 83105us (83296us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607699.671853:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 183 00000100:00100000:3.0:1782607699.673794:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782607699.677474:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364404096:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1782607699.677589:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607699.677899:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364404096 00000100:00100000:1.0:1782607699.677916:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364404096 00000100:00100000:1.0:1782607699.677994:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1782607699.678005:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9744437c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364404096:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1782607699.678276:0:6608:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1782607699.678280:0:6608:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1782607700 00002000:00010000:1.0:1782607699.678283:0:6608:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1782607699.678285:0:6608:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1782607700 -> 1782607700 00002000:00010000:1.0:1782607699.678287:0:6608:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1782607699.678353:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9744437c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3317:x1869199364404096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 349us (764us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1782607699.678361:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000004:00080000:1.0:1782607699.678419:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9745676e8a80/2, rc 0, transno 4294967315 00000100:00100000:1.0:1782607699.678427:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364404096:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1782607699.682302:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607699.682400:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342386176 00000100:00100000:0.0:1782607699.682413:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342386176 00000100:00100000:0.0:1782607699.682492:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 56 00000100:00100000:0.0:1782607699.682506:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9744437c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+10:2356:x1869199342386176:12345-192.168.202.4@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1782607699.861134:0:6634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:1.0:1782607699.861160:0:6634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:3.0:1782607699.861478:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9744437c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:2356:x1869199342386176:12345-192.168.202.4@tcp:16:lhsmtool_posix.0 Request processed in 178965us (179182us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607699.861493:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 56 00000100:00100000:1.0:1782607699.867722:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607699.868048:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342386432 00000100:00100000:0.0:1782607699.868062:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342386432 00000100:00100000:0.0:1782607699.868176:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 184 00000100:00100000:0.0:1782607699.868191:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+19:11499:x1869199342386432:12345-192.168.202.4@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1782607699.868279:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782607699.868319:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbd73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff6c expref: 19 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.868357:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9745454f5600) 00010000:00010000:0.0:1782607699.868365:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782607699.868526:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbd88 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.868546:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbd88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.868564:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbd88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782607699.869084:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000023163578 reply state 00000000522a82ac transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbd88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607699.869098:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782607699.869243:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+20:11499:x1869199342386432:12345-192.168.202.4@tcp:36:lhsmtool_posix.0 Request processed in 1053us (1535us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1782607699.869252:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 184 00000100:00100000:1.0:1782607699.873026:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607699.873075:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342386560 00000100:00100000:1.0:1782607699.873088:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342386560 00000100:00100000:1.0:1782607699.873160:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 57 00000100:00100000:1.0:1782607699.873172:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581267b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:2357:x1869199342386560:12345-192.168.202.4@tcp:2:lhsmtool_posix.0 00010000:00010000:3.0:1782607699.874059:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbd88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.874076:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbd88 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.874085:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbd88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.874092:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42200 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:3.0:1782607699.874098:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbd88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.874108:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbd88 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.874130:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9745454f5600) 00010000:00010000:3.0:1782607699.874133:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782607699.874140:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbd88 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.874147:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbd88 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782607699.874384:0:6608:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1782607699.874389:0:6608:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1782607700 -> 1782607699 00002000:00010000:1.0:1782607699.874392:0:6608:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1782607697 00002000:00010000:1.0:1782607699.874396:0:6608:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1782607700 -> 1782607699 00002000:00010000:1.0:1782607699.874398:0:6608:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1782607699.874615:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581267b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+8:2357:x1869199342386560:12345-192.168.202.4@tcp:2:lhsmtool_posix.0 Request processed in 1440us (1606us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1782607699.874644:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 57 00000100:00100000:1.0:1782607699.878340:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607699.878440:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342386816 00000100:00100000:3.0:1782607699.878454:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342386816 00000100:00100000:3.0:1782607699.878536:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 185 00000100:00100000:3.0:1782607699.878549:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+19:11499:x1869199342386816:12345-192.168.202.4@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1782607699.878664:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cbd8f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.878685:0:7437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbd57 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff5e expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.878696:0:7437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cbd8f lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.878744:0:7437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbd57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff5e expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.878761:0:7437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbd57 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff5e expref: 19 pid: 5803 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607699.878802:0:7437:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9744437c5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7437:1869199364404224:192.168.202.4@tcp:104: 00000100:00100000:3.0:1782607699.878949:0:7437:0:(client.c:2701:ptlrpc_set_wait()) set ffff974442a7c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782607699.885740:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607699.885845:0:7437:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9744437c5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7437:1869199364404224:192.168.202.4@tcp:104: 00010000:00010000:3.0:1782607699.885900:0:7437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cbd8f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607699.889319:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342386944 00000100:00100000:3.0:1782607699.889359:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342386944 00010000:00010000:3.0:1782607699.889444:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbd57 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff5e expref: 20 pid: 5803 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607699.889512:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 69 00000100:00100000:3.0:1782607699.889541:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455109e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+20:2356:x1869199342386944:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782607699.889562:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782607699.889572:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbd57 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff5e expref: 20 pid: 5803 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.889591:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbd57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff5e expref: 20 pid: 5803 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.889625:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cbd57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff5e expref: 20 pid: 5803 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.889648:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9745454f5600) 00010000:00010000:3.0:1782607699.889655:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cbd8f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.889668:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cbd8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.889679:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cbd8f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.889716:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782607699.889842:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455109e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+19:2356:x1869199342386944:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 303us (4116us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607699.889852:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 69 00010000:00010000:3.0:1782607699.890119:0:7437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cbd8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.890129:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cbd8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.890175:0:7437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cbd8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.890183:0:7437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cbd8f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.890189:0:7437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cbd8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.890196:0:7437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d649200 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:3.0:1782607699.890202:0:7437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cbd8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.890212:0:7437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cbd8f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.890222:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9745454f5600) 00010000:00010000:3.0:1782607699.890225:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1782607699.890229:0:7437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cbd8f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.890235:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cbd8f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607699.890283:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+18:11499:x1869199342386816:12345-192.168.202.4@tcp:55:lhsmtool_posix.0 Request processed in 11737us (11959us total) trans 0 rc -22/-22 00000100:00100000:3.0:1782607699.890293:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 185 00000100:00100000:2.0:1782607699.899595:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607699.899679:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342387072 00000100:00100000:3.0:1782607699.899696:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342387072 00000100:00100000:3.0:1782607699.900020:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 58 00000100:00100000:3.0:1782607699.900041:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443760380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+8:2356:x1869199342387072:12345-192.168.202.4@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1782607699.900104:0:6609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c96a48b3/0x8109266df35cbd96 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.900130:0:6609:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006ef4849e/0x8109266df35cbd81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff7a expref: 8 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.900142:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782607699.900147:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782607699.900151:0:6609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c96a48b3/0x8109266df35cbd96 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.900200:0:6609:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006ef4849e/0x8109266df35cbd81 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff7a expref: 8 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.900216:0:6609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006ef4849e/0x8109266df35cbd81 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff7a expref: 8 pid: 6609 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607699.900233:0:6609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9744437c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6609:1869199364404352:192.168.202.4@tcp:104: 00000100:00100000:3.0:1782607699.900393:0:6609:0:(client.c:2701:ptlrpc_set_wait()) set ffff974442a7ccc0 going to sleep for 11 seconds 00000040:00080000:0.0:1782607699.902615:0:12336:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782607699.902625:0:12336:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782607699.902660:0:12336:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1782607699.902664:0:12336:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782607699.907078:0:6609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9744437c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6609:1869199364404352:192.168.202.4@tcp:104: 00010000:00010000:3.0:1782607699.907127:0:6609:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c96a48b3/0x8109266df35cbd96 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607699.908127:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607699.908221:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342387200 00000100:00100000:0.0:1782607699.908232:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342387200 00010000:00010000:0.0:1782607699.908284:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006ef4849e/0x8109266df35cbd81 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff7a expref: 9 pid: 6609 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607699.908333:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 70 00000100:00100000:0.0:1782607699.908345:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443760a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+9:2357:x1869199342387200:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782607699.908365:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782607699.908397:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006ef4849e/0x8109266df35cbd81 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff7a expref: 9 pid: 6609 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.908413:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006ef4849e/0x8109266df35cbd81 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff7a expref: 9 pid: 6609 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.908535:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ef4849e/0x8109266df35cbd81 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff7a expref: 9 pid: 6609 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.908554:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782607699.908560:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782607699.908567:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c96a48b3/0x8109266df35cbd96 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.908577:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c96a48b3/0x8109266df35cbd96 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.908610:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782607699.908677:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443760a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+8:2357:x1869199342387200:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 333us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607699.908686:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 70 00010000:00010000:3.0:1782607699.909655:0:6609:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c96a48b3/0x8109266df35cbd96 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.909677:0:6609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c96a48b3/0x8109266df35cbd96 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.909709:0:6609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c96a48b3/0x8109266df35cbd96 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.909714:0:6609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c96a48b3/0x8109266df35cbd96 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.909721:0:6609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c96a48b3/0x8109266df35cbd96 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.909727:0:6609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d648c00 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:3.0:1782607699.909731:0:6609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c96a48b3/0x8109266df35cbd96 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.909737:0:6609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c96a48b3/0x8109266df35cbd96 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.909750:0:6609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c96a48b3/0x8109266df35cbd96 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.909755:0:6609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c96a48b3/0x8109266df35cbd96 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607699.909971:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443760380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:2356:x1869199342387072:12345-192.168.202.4@tcp:1:lhsmtool_posix.0 Request processed in 9931us (10384us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607699.909982:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 58 00000100:00100000:2.0:1782607699.926690:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607699.926754:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342387456 00000100:00100000:0.0:1782607699.926799:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342387456 00000100:00100000:0.0:1782607699.926970:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 186 00000100:00100000:0.0:1782607699.926984:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+18:11499:x1869199342387456:12345-192.168.202.4@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1782607699.927096:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbd9d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.927117:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbd9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.927130:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbd9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.927611:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbda4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.927625:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbd65 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff65 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.927634:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbda4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.927677:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbd65 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff65 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.927693:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbd65 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff65 expref: 19 pid: 5803 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607699.927711:0:5805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676e9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1869199364404480:192.168.202.4@tcp:104: 00000100:00100000:0.0:1782607699.927921:0:5805:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745509bf3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782607699.938429:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607699.940065:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342387584 00000100:00100000:1.0:1782607699.940080:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342387584 00010000:00010000:1.0:1782607699.940138:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbd65 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff65 expref: 20 pid: 5803 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607699.940186:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 71 00000100:00100000:1.0:1782607699.940197:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+20:2356:x1869199342387584:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782607699.940216:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782607699.940225:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbd65 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff65 expref: 20 pid: 5803 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.940240:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbd65 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff65 expref: 20 pid: 5803 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.940267:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9745454f5600) 00010000:00010000:1.0:1782607699.940274:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbda4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.940285:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbda4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.940294:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbda4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.940320:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782607699.940403:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+20:2356:x1869199342387584:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 206us (1992us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607699.940420:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 71 00010000:00010000:3.0:1782607699.941240:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cbd65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff65 expref: 19 pid: 5803 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607699.941257:0:5805:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676e9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1869199364404480:192.168.202.4@tcp:104: 00010000:00010000:3.0:1782607699.941283:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbda4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.941292:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbda4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.941297:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbda4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782607699.941578:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1782607699.941711:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1782607699.941747:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1782607699.941861:0:5805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9744437c5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5805:1869199364404608:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1782607699.942064:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607699.942103:0:5805:0:(client.c:2701:ptlrpc_set_wait()) set ffff974442a7cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1782607699.942113:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364404608 00000100:00100000:1.0:1782607699.942121:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364404608 00000100:00100000:1.0:1782607699.942168:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782607699.942178:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9744437c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5805:x1869199364404608:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1782607699.942400:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9744437c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5805:x1869199364404608:12345-0@lo:1000:mdt00_002.0 Request processed in 222us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607699.942470:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782607699.942524:0:5805:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1782607699.942531:0:5805:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9745676e8a80, transno 4294967315 00000100:00100000:3.0:1782607699.942648:0:5805:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9744437c5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5805:1869199364404608:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1782607699.943357:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1782607699.943969:0:5805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9744437c5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5805:1869199364404736:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1782607699.944034:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607699.945021:0:5805:0:(client.c:2701:ptlrpc_set_wait()) set ffff974442a7ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782607699.946068:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364404736 00000100:00100000:1.0:1782607699.946080:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364404736 00000100:00100000:1.0:1782607699.946543:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782607699.946553:0:5809:0:(service.c:3461:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1782607699.946558:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974548949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5805:x1869199364404736:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1782607699.946565:0:5809:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1782607699.946924:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974548949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5805:x1869199364404736:12345-0@lo:1000:mdt00_002.0 Request processed in 369us (2887us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1782607699.946944:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782607699.946997:0:5805:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9744437c5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5805:1869199364404736:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1782607699.947057:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbda4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.947068:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbda4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.947075:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbda4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.947082:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42600 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:3.0:1782607699.947087:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbda4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.947096:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbda4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.947116:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9745454f5600) 00010000:00010000:3.0:1782607699.947119:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782607699.947124:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbda4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.947130:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbda4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.947166:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbce0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.947172:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbce0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.947184:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbce0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.947189:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974541548a00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:3.0:1782607699.947192:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbce0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.947197:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbce0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.947205:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745432c6b00) 00010000:00010000:3.0:1782607699.947208:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782607699.947211:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbce0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.947217:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbce0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.947242:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cbdab lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.947259:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cbcfc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff49 expref: 22 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.947268:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cbdab lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.947306:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cbcfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff49 expref: 22 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607699.947321:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cbcfc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff49 expref: 22 pid: 7437 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607699.947656:0:5805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f4b4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1869199364404864:192.168.202.4@tcp:104: 00000100:00100000:3.0:1782607699.947826:0:5805:0:(client.c:2701:ptlrpc_set_wait()) set ffff974442a7ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782607699.951438:0:5805:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f4b4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1869199364404864:192.168.202.4@tcp:104: 00010000:00010000:3.0:1782607699.951479:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cbdab lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607699.952124:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607699.952204:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342387712 00000100:00100000:0.0:1782607699.952213:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342387712 00010000:00010000:0.0:1782607699.952255:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cbcfc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff49 expref: 23 pid: 7437 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607699.952297:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 72 00000100:00100000:0.0:1782607699.952305:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+23:2357:x1869199342387712:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782607699.952320:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782607699.952326:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cbcfc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff49 expref: 23 pid: 7437 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.952354:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cbcfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff49 expref: 23 pid: 7437 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.952381:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cbcfc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff49 expref: 23 pid: 7437 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.952395:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745432c6b00) 00010000:00010000:0.0:1782607699.952400:0:5787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cbdab lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.952409:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cbdab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.952415:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cbdab lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.952436:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782607699.952501:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+22:2357:x1869199342387712:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 195us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607699.952511:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 72 00010000:00010000:0.0:1782607699.952606:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cbdab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.952613:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cbdab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.952625:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cbdab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.952639:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cbdab lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.952645:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cbdab lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.952652:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d648c00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607699.952658:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cbdab lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.952668:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cbdab lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.952678:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745432c6b00) 00010000:00010000:0.0:1782607699.952681:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782607699.952685:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cbdab lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.952691:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cbdab lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.952703:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbd9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.952709:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbd9d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.952715:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbd9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.952720:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42c00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607699.952729:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbd9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.952736:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbd9d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.952746:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745432c6b00) 00010000:00010000:0.0:1782607699.952749:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782607699.952752:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbd9d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607699.952758:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbd9d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607699.953079:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+21:11499:x1869199342387456:12345-192.168.202.4@tcp:57:lhsmtool_posix.0 Request processed in 26097us (26396us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1782607699.953088:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 186 00000020:00080000:0.0:1782607699.953093:0:5805:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1782607699.953227:0:11563:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782607699.953234:0:11563:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782607699.953733:0:11563:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1782607699.953743:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782607699.958310:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607699.958525:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342387968 00000100:00100000:1.0:1782607699.958537:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342387968 00000100:00100000:1.0:1782607699.958642:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 50 00000100:00100000:1.0:1782607699.958655:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549b8b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+21:11499:x1869199342387968:12345-192.168.202.4@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1782607699.959584:0:5807:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1782607699.959704:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:1.0:1782607699.959760:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466e00/0x8109266df35cbdb2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.959811:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466e00/0x8109266df35cbdb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.959837:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466e00/0x8109266df35cbdb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.959847:0:5807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466e00/0x8109266df35cbdb2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.959854:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466e00/0x8109266df35cbdb2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.959860:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466e00/0x8109266df35cbdb2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.959878:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782607699.960010:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549b8b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+23:11499:x1869199342387968:12345-192.168.202.4@tcp:35:lhsmtool_posix.0 Request processed in 1356us (1714us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1782607699.960020:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 50 00000020:00080000:1.0:1782607699.960025:0:5807:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1782607699.960309:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782607699.960316:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466e00/0x8109266df35cbdb2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.960325:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f466e00 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:1.0:1782607699.960329:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466e00/0x8109266df35cbdb2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.960338:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466e00/0x8109266df35cbdb2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.960355:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff974543e77200) 00010000:00010000:1.0:1782607699.960359:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782607699.960373:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466e00/0x8109266df35cbdb2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.960380:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466e00/0x8109266df35cbdb2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607699.960398:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607699.960458:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607699.960462:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607700.226029:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607700.546379:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fae11c6e-4506-4104-bb8c-df42498f7e08:3317:1869199364404992:0@lo:400:kworker.0 00000100:00100000:3.0:1782607700.546406:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1869199364405120:0@lo:400:kworker.0 00000100:00100000:2.0:1782607700.546498:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364405376:0@lo:400:kworker.0 00000100:00100000:3.0:1782607700.556091:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607700.556188:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364405632:0@lo:400:kworker.0 00000100:00100000:3.0:1782607700.556237:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607700.556278:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782607700.556286:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1869199364405248:0@lo:400:kworker.0 00000100:00100000:3.0:1782607700.556308:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607700.556371:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364405120 00000100:00100000:0.0:1782607700.556781:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364405248 00000100:00100000:0.0:1782607700.556789:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364405248 00000100:00100000:0.0:1782607700.557525:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1782607700.557544:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457718f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1869199364405248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607700.557659:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457718f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1869199364405248:12345-0@lo:400:kworker.0 Request processed in 123us (1349us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607700.557667:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1782607700.557709:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364405632 00000100:00100000:0.0:1782607700.557734:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364405632 00000100:00100000:2.0:1782607700.557985:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607700.558586:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364405120 00000100:00100000:3.0:1782607700.558643:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1782607700.558652:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1869199364405120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607700.558708:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1869199364405120:12345-0@lo:400:kworker.0 Request processed in 58us (2629us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607700.558714:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:3.0:1782607700.558740:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782607700.558746:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782607700.558823:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1869199364405248:0@lo:400:kworker.0 00000100:00100000:3.0:1782607700.558838:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1869199364405120:0@lo:400:kworker.0 00000100:00100000:1.0:1782607700.564365:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607700.564450:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3317:1869199364405504:0@lo:400:kworker.0 00000100:00100000:1.0:1782607700.564519:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607700.564550:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364405504 00000100:00100000:1.0:1782607700.564558:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364405504 00000100:00100000:1.0:1782607700.564613:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1782607700.564622:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869199364405504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607700.564672:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869199364405504:12345-0@lo:400:kworker.0 Request processed in 51us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607700.564679:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1782607700.565025:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364404992 00000100:00100000:3.0:1782607700.565039:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364404992 00000100:00100000:3.0:1782607700.565110:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1782607700.565122:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3317:x1869199364404992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607700.565215:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3317:x1869199364404992:12345-0@lo:400:kworker.0 Request processed in 96us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607700.565224:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00080000:3.0:1782607700.565268:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782607700.568639:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3317:1869199364405504:0@lo:400:kworker.0 00000100:00100000:1.0:1782607700.568684:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fae11c6e-4506-4104-bb8c-df42498f7e08:3317:1869199364404992:0@lo:400:kworker.0 00000100:00100000:0.0:1782607700.573652:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364405376 00000100:00100000:0.0:1782607700.573673:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364405376 00000100:00100000:3.0:1782607700.580717:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1782607700.585595:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457718df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3318:x1869199364405632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607700.585757:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457718df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3318:x1869199364405632:12345-0@lo:400:kworker.0 Request processed in 5022us (29518us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607700.585821:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1782607700.585880:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1782607700.585893:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443761180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3316:x1869199364405376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607700.585959:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443761180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3316:x1869199364405376:12345-0@lo:400:kworker.0 Request processed in 70us (27982us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607700.585965:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1782607700.586027:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364405376:0@lo:400:kworker.0 00000100:00100000:3.0:1782607700.586299:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364405632:0@lo:400:kworker.0 00010000:00010000:0.0:1782607701.251499:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782607701.620642:0:7525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000040:00080000:3.0:1782607701.848461:0:12389:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782607701.848471:0:12389:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782607701.848514:0:12389:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1782607701.848520:0:12389:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782607701.991295:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607701.991373:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342388224 00000100:00100000:2.0:1782607701.991382:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342388224 00000100:00100000:2.0:1782607701.991457:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 187 00000100:00100000:2.0:1782607701.991468:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745509ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+23:11518:x1869199342388224:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1782607701.991492:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607701.991513:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbdb9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629fff81 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607701.991822:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974541549200/0x8109266df35cbdc0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607701.991838:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974541549200/0x8109266df35cbdc0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607701.991850:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541549200/0x8109266df35cbdc0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782607701.991862:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1782607701.992169:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbdb9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff81 expref: 26 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607701.992187:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974541549200/0x8109266df35cbdc0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff81 expref: 25 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607701.992197:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97454be19200) 00010000:00010000:2.0:1782607701.992200:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782607701.992203:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974541549200, rc 0) 00000100:00100000:2.0:1782607701.992254:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745509ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+25:11518:x1869199342388224:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 788us (970us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1782607701.992271:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 187 00000100:00080000:3.0:1782607701.994012:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782607701.997726:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607702.000593:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342388352 00000100:00100000:0.0:1782607702.000608:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342388352 00000100:00100000:0.0:1782607702.000664:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 188 00000100:00100000:0.0:1782607702.000674:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745509eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+25:11518:x1869199342388352:12345-192.168.202.4@tcp:34:lfs.0 00010000:00010000:0.0:1782607702.000754:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbdce lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.000785:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbdce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.000797:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbdce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.000815:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cbdd5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.000822:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cbdd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.000828:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cbdd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.001996:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbddc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.002008:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbddc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.002014:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbddc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782607702.002059:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbddc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.002069:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbdce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.002073:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbdce lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.002077:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbdce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.002081:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42c00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607702.002084:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbdce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.002088:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbdce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.002097:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97454be19200) 00010000:00010000:0.0:1782607702.002100:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782607702.002102:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbdce lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.002106:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbdce lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.002113:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cbdd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.002117:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cbdd5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.002124:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cbdd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.002127:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42a00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607702.002129:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cbdd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.002132:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cbdd5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.002136:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97454be19f00) 00010000:00010000:0.0:1782607702.002137:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782607702.002139:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cbdd5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.002142:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42a00/0x8109266df35cbdd5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.002151:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbddc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.002154:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbddc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.002157:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbddc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.002160:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42600 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607702.002161:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbddc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.002170:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbddc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.002174:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97454be19c00) 00010000:00010000:0.0:1782607702.002176:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782607702.002177:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbddc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.002180:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbddc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607702.002341:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745509eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+25:11518:x1869199342388352:12345-192.168.202.4@tcp:34:lfs.0 Request processed in 1666us (4622us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607702.002348:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 188 00000040:00080000:0.0:1782607702.017981:0:11563:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782607702.017991:0:11563:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782607702.018029:0:11563:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1782607702.018036:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782607702.033099:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607702.033676:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342388608 00000100:00100000:2.0:1782607702.033696:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342388608 00000100:00100000:2.0:1782607702.033760:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 189 00000100:00100000:2.0:1782607702.033797:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+25:11521:x1869199342388608:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1782607702.033818:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607702.033839:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbde3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629fff88 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.033923:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548400/0x8109266df35cbdea lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.033938:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974541548400/0x8109266df35cbdea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.033949:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541548400/0x8109266df35cbdea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.033964:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbdf1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.033971:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbdf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.033978:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbdf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.034739:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbdf8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.034758:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbdf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.034778:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbdf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782607702.034787:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1782607702.034881:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548400/0x8109266df35cbdea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.034889:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974541548400/0x8109266df35cbdea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.034896:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974541548400/0x8109266df35cbdea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.034902:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974541548400 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607702.034906:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541548400/0x8109266df35cbdea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.034930:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541548400/0x8109266df35cbdea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.034945:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97454be19200) 00010000:00010000:2.0:1782607702.034948:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607702.034953:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974541548400/0x8109266df35cbdea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.034959:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541548400/0x8109266df35cbdea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.034973:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbdf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.034985:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbdf1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.034990:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbdf1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.034994:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974541549a00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607702.034996:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbdf1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.035002:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbdf1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.035009:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9745432c6300) 00010000:00010000:2.0:1782607702.035012:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607702.035015:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbdf1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.035020:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbdf1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.035067:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbde3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff88 expref: 28 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.035081:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbdf8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff88 expref: 27 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.035089:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745432c6f00) 00010000:00010000:2.0:1782607702.035091:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782607702.035101:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974541548e00, rc 0) 00000100:00100000:2.0:1782607702.035159:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+27:11521:x1869199342388608:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 1365us (2071us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1782607702.035168:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 189 00000100:00100000:3.0:1782607702.040746:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607702.048711:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342388736 00000100:00100000:1.0:1782607702.048743:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342388736 00000100:00100000:0.0:1782607702.049136:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 190 00000100:00100000:0.0:1782607702.049150:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+27:11521:x1869199342388736:12345-192.168.202.4@tcp:54:lfs.0 00010000:00010000:0.0:1782607702.049256:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbe06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.049281:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbe06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.049296:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbe06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.049365:0:7437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbe06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.049373:0:7437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbe06 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.049381:0:7437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbe06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.049388:0:7437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42600 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607702.049394:0:7437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbe06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.049404:0:7437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbe06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.049423:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745432c6f00) 00010000:00010000:0.0:1782607702.049426:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782607702.049432:0:7437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbe06 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.049439:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbe06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607702.049572:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+27:11521:x1869199342388736:12345-192.168.202.4@tcp:54:lfs.0 Request processed in 424us (8850us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607702.049582:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 190 00000100:00100000:1.0:1782607702.069837:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607702.069881:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342388992 00000100:00100000:1.0:1782607702.069891:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342388992 00000100:00100000:1.0:1782607702.069958:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 51 00000100:00100000:1.0:1782607702.069974:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+27:11521:x1869199342388992:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:1.0:1782607702.070244:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+28:11521:x1869199342388992:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 260us (406us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1782607702.070252:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 51 00000100:00100000:0.0:1782607702.123259:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607702.123883:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342389248 00000100:00100000:2.0:1782607702.123894:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342389248 00000100:00100000:2.0:1782607702.123966:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 191 00000100:00100000:2.0:1782607702.123977:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+28:11047:x1869199342389248:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:2.0:1782607702.124002:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607702.124023:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbe0d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629fff8f expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.124129:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbe14 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.124144:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbdf8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff88 expref: 29 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.124164:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbe14 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.124202:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbdf8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff88 expref: 29 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.124215:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbdf8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff88 expref: 29 pid: 5805 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607702.124361:0:5805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974443762680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1869199364405760:192.168.202.4@tcp:104: 00000100:00100000:2.0:1782607702.124467:0:5805:0:(client.c:2701:ptlrpc_set_wait()) set ffff97457f49e840 going to sleep for 11 seconds 00000100:00100000:1.0:1782607702.135897:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607702.136017:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342389376 00000100:00100000:0.0:1782607702.136030:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342389376 00010000:00010000:0.0:1782607702.136104:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbdf8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff88 expref: 30 pid: 5805 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607702.136165:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 73 00000100:00100000:0.0:1782607702.136177:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457fad7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+30:2356:x1869199342389376:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782607702.136198:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782607702.136206:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbdf8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff88 expref: 30 pid: 5805 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.136223:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbdf8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff88 expref: 30 pid: 5805 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.136253:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745432c6f00) 00010000:00010000:0.0:1782607702.136259:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbe14 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.136270:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbe14 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.136278:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbe14 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.136302:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782607702.136377:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457fad7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+30:2356:x1869199342389376:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 200us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607702.136386:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 73 00010000:00010000:2.0:1782607702.138515:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbdf8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff88 expref: 29 pid: 5805 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607702.138546:0:5805:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974443762680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1869199364405760:192.168.202.4@tcp:104: 00010000:00010000:2.0:1782607702.138573:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbe14 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607702.138905:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbe14 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607702.138923:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbe14 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782607702.138946:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1782607702.139108:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbe0d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff8f expref: 30 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607702.139126:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbe14 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff8f expref: 29 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607702.139135:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745432c6f00) 00010000:00010000:1.0:1782607702.139138:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782607702.139141:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974541549a00, rc 0) 00000100:00100000:1.0:1782607702.139222:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+29:11047:x1869199342389248:12345-192.168.202.4@tcp:101:bash.0 Request processed in 15246us (15973us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1782607702.139377:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 191 00000100:00100000:1.0:1782607702.143676:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607702.143795:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342389632 00000100:00100000:0.0:1782607702.143823:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342389632 00000100:00100000:0.0:1782607702.143924:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 192 00000100:00100000:0.0:1782607702.143959:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97454894b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+29:11047:x1869199342389632:12345-192.168.202.4@tcp:36:bash.0 00010000:00010000:0.0:1782607702.144317:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbe22 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.144339:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbe22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.144353:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbe22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782607702.144434:0:7437:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:0.0:1782607702.144461:0:7437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b9d66eb8 reply state 0000000033fa8a08 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbe22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607702.144472:0:7437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1782607702.144525:0:7437:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:0.0:1782607702.144667:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97454894b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+33:11047:x1869199342389632:12345-192.168.202.4@tcp:36:bash.0 Request processed in 712us (1000us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1782607702.144676:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 192 00000020:00080000:0.0:1782607702.144682:0:7437:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1782607702.147102:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbe22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.147122:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbe22 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.147130:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbe22 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.147137:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42600 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607702.147142:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbe22 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.147168:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbe22 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.147190:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745432c6f00) 00010000:00010000:0.0:1782607702.147193:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782607702.147198:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbe22 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.147204:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbe22 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607702.150436:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607702.150688:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342389760 00000100:00100000:2.0:1782607702.150701:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342389760 00000100:00100000:2.0:1782607702.150816:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 193 00000100:00100000:2.0:1782607702.150827:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+32:11047:x1869199342389760:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:2.0:1782607702.150868:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607702.150895:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbe29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629fff96 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.150984:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbe29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff96 expref: 33 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.151002:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbe29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff96 expref: 33 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.151027:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745432c6f00) 00010000:00010000:2.0:1782607702.151030:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782607702.151034:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974541548e00, rc 0) 00000100:00100000:2.0:1782607702.151113:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+33:11047:x1869199342389760:12345-192.168.202.4@tcp:101:bash.0 Request processed in 287us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607702.151121:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 193 00000100:00100000:3.0:1782607702.161956:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607702.162353:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342389888 00000100:00100000:2.0:1782607702.162386:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342389888 00000100:00080000:3.0:1782607702.162557:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782607702.162607:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 59 00000100:00100000:2.0:1782607702.162622:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745799e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:11047:x1869199342389888:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:2.0:1782607702.162647:0:6610:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607702.162674:0:6610:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe97f639/0x8109266df35cbe30 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629fff9d expref: -99 pid: 6610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782607702.162710:0:6610:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a406f53, atime: 0x6a406f51, ctime: 0x6a406f53, blocks: 0xb 00010000:00010000:2.0:1782607702.162736:0:6610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=361s v=(0 0) 00010000:00010000:2.0:1782607702.162742:0:6610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782607702.162752:0:6610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe97f639/0x8109266df35cbe30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff9d expref: 8 pid: 6610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.162804:0:6610:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fe97f639/0x8109266df35cbe30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff9d expref: 8 pid: 6610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.162819:0:6610:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974541548400, rc 0) 00000100:00100000:2.0:1782607702.162920:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745799e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+8:11047:x1869199342389888:12345-192.168.202.4@tcp:101:bash.0 Request processed in 294us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607702.162929:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 59 00000100:00100000:3.0:1782607702.165429:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607702.165546:0:6614:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342390016 00000100:00100000:2.0:1782607702.165560:0:6614:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342390016 00002000:00010000:2.0:1782607702.165616:0:6614:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1782607702.165622:0:6614:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974581009c00 with x1869199342390016 ext(0->18446744073709551615) 00002000:00010000:2.0:1782607702.165638:0:6614:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974581009c00. 00000100:00100000:2.0:1782607702.165717:0:6614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 6 00000100:00100000:2.0:1782607702.165729:0:6614:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+8:2354:x1869199342390016:12345-192.168.202.4@tcp:10:bash.0 00002000:00010000:2.0:1782607702.166281:0:6614:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1782607702.166286:0:6614:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1782607699 -> 1782607703 00002000:00010000:2.0:1782607702.166289:0:6614:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1782607697 -> 1782607697 00002000:00010000:2.0:1782607702.166291:0:6614:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1782607699 -> 1782607703 00002000:00010000:2.0:1782607702.166294:0:6614:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1782607702.166375:0:6614:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+9:2354:x1869199342390016:12345-192.168.202.4@tcp:10:bash.0 Request processed in 648us (959us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1782607702.166384:0:6614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 6 00002000:00010000:2.0:1782607702.166388:0:6614:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1782607702.166391:0:6614:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974581009c00 with x1869199342390016 ext(0->18446744073709551615) 00002000:00010000:2.0:1782607702.166396:0:6614:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff974581009c00. 00000100:00100000:3.0:1782607702.259861:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607702.259947:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607702.260348:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607702.260411:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607702.260434:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607702.260479:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342390400 00000100:00100000:3.0:1782607702.260493:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342390400 00000100:00100000:3.0:1782607702.260561:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342390528 00000100:00100000:3.0:1782607702.260564:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342390528 00000100:00100000:3.0:1782607702.260602:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 100 00000100:00100000:3.0:1782607702.260615:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+9:2357:x1869199342390400:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1782607702.260719:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+9:2357:x1869199342390400:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 107us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607702.260728:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 100 00000100:00100000:3.0:1782607702.260752:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 101 00000100:00100000:3.0:1782607702.260758:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580c06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2357:x1869199342390528:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1782607702.261170:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342390144 00000100:00100000:1.0:1782607702.261176:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342390144 00000100:00100000:1.0:1782607702.261232:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 300 00000100:00100000:1.0:1782607702.261240:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2357:x1869199342390144:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1782607702.261277:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2357:x1869199342390144:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 38us (1432us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607702.261284:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 300 00000100:00080000:1.0:1782607702.261345:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782607702.262498:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580c06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2357:x1869199342390528:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 1731us (2053us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607702.262550:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342390656 00000100:00100000:0.0:1782607702.262560:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342390656 00000100:00100000:3.0:1782607702.262616:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 101 00000100:00100000:0.0:1782607702.262623:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342390272 00000100:00100000:0.0:1782607702.262627:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342390272 00000100:00100000:0.0:1782607702.262654:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 164 00000100:00100000:0.0:1782607702.262664:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2357:x1869199342390656:12345-192.168.202.4@tcp:400:kworker.0 00000100:00080000:3.0:1782607702.262675:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782607702.262702:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 165 00000100:00100000:0.0:1782607702.262712:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2357:x1869199342390656:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 48us (2363us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607702.262715:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580c04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+33:2357:x1869199342390272:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1782607702.262727:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 164 00000100:00100000:3.0:1782607702.262791:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580c04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+33:2357:x1869199342390272:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 52us (2351us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607702.262799:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 165 00010000:00010000:1.0:1782607702.275540:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782607702.299573:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607702.299816:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342390784 00000100:00100000:0.0:1782607702.299832:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342390784 00000100:00100000:0.0:1782607702.299924:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 194 00000100:00100000:0.0:1782607702.299939:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581538700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+33:11535:x1869199342390784:12345-192.168.202.4@tcp:34:lfs.0 00010000:00010000:0.0:1782607702.300040:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbe37 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.300062:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbe37 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.300096:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbe37 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.300117:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbe3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.300125:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbe3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.300132:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbe3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.300523:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cbe45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.300535:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cbe45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.300542:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cbe45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782607702.300601:0:7437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cbe45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.300615:0:7437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbe37 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.300622:0:7437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbe37 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.300631:0:7437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbe37 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.300649:0:7437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42600 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607702.300654:0:7437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbe37 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.300663:0:7437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbe37 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.300680:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97454be19200) 00010000:00010000:0.0:1782607702.300683:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782607702.300689:0:7437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbe37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.300696:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbe37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.300714:0:7437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbe3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.300721:0:7437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbe3e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.300727:0:7437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbe3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.300732:0:7437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42c00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607702.300734:0:7437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbe3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.300741:0:7437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbe3e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.300760:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97454be19c00) 00010000:00010000:0.0:1782607702.301072:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782607702.301078:0:7437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbe3e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.301084:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbe3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.301102:0:7437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cbe45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.301109:0:7437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cbe45 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.301115:0:7437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cbe45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.301120:0:7437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c43400 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607702.301124:0:7437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cbe45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.301129:0:7437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cbe45 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.301139:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745432c6f00) 00010000:00010000:0.0:1782607702.301141:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782607702.301144:0:7437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cbe45 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.301150:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cbe45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607702.301312:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581538700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+33:11535:x1869199342390784:12345-192.168.202.4@tcp:34:lfs.0 Request processed in 1373us (1751us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607702.301324:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 194 00000100:00100000:1.0:1782607702.394166:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607702.397950:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342391040 00000100:00100000:2.0:1782607702.397974:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342391040 00000100:00100000:2.0:1782607702.398093:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 195 00000100:00100000:2.0:1782607702.398105:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+33:11538:x1869199342391040:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1782607702.398132:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607702.398161:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbe4c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629fffa4 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.398272:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbe53 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.398292:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbe53 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.398306:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbe53 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.398356:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cbe5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.398365:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cbe5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.398372:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cbe5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.398870:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cbe61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.398881:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cbe61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.398889:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cbe61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782607702.398901:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1782607702.399045:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbe53 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.399054:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbe53 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.399062:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbe53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.399069:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974541548c00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607702.399074:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbe53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.399095:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbe53 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.399114:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97454be19200) 00010000:00010000:2.0:1782607702.399118:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607702.399125:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbe53 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.399132:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbe53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.399150:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cbe5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.399156:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cbe5a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.399162:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cbe5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.399169:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ada00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607702.399172:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cbe5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.399178:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cbe5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.399185:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9745432c6600) 00010000:00010000:2.0:1782607702.399188:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607702.399191:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cbe5a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.399206:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cbe5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.399264:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbe4c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffa4 expref: 36 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.399280:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cbe61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffa4 expref: 35 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.399287:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745432c6f00) 00010000:00010000:2.0:1782607702.399290:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1782607702.399293:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585ad000, rc 0) 00000100:00100000:2.0:1782607702.399392:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+35:11538:x1869199342391040:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 1288us (5242us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1782607702.399402:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 195 00000100:00100000:1.0:1782607702.408334:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607702.408449:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342391168 00000100:00100000:3.0:1782607702.408464:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342391168 00000100:00100000:3.0:1782607702.408563:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 196 00000100:00100000:3.0:1782607702.408576:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+35:11538:x1869199342391168:12345-192.168.202.4@tcp:54:lfs.0 00010000:00010000:3.0:1782607702.408671:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cbe6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607702.408691:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbe14 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff8f expref: 35 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607702.408703:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cbe6f lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607702.408747:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbe14 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff8f expref: 35 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607702.408815:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbe14 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff8f expref: 35 pid: 5805 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607702.408834:0:5805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97458153aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1869199364405888:192.168.202.4@tcp:104: 00000100:00100000:3.0:1782607702.408967:0:5805:0:(client.c:2701:ptlrpc_set_wait()) set ffff974442a7c480 going to sleep for 11 seconds 00000100:00100000:3.0:1782607702.411723:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607702.411837:0:5805:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97458153aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1869199364405888:192.168.202.4@tcp:104: 00010000:00010000:1.0:1782607702.411870:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cbe6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607702.412961:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342391424 00000100:00100000:2.0:1782607702.412977:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342391424 00000100:00100000:2.0:1782607702.413055:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 52 00000100:00100000:2.0:1782607702.413066:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581539c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+36:5568:x1869199342391424:12345-192.168.202.4@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1782607702.413503:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581539c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+37:5568:x1869199342391424:12345-192.168.202.4@tcp:35:ldlm_bl.0 Request processed in 437us (1791us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1782607702.413513:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 52 00000100:00100000:1.0:1782607702.419977:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607702.420172:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342391552 00000100:00100000:3.0:1782607702.420187:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342391552 00010000:00010000:3.0:1782607702.420253:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbe14 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff8f expref: 37 pid: 5805 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607702.420638:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 74 00000100:00100000:3.0:1782607702.420653:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+37:2357:x1869199342391552:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782607702.420675:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782607702.420699:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbe14 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff8f expref: 37 pid: 5805 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607702.420714:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbe14 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff8f expref: 37 pid: 5805 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607702.420743:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbe14 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff8f expref: 37 pid: 5805 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607702.420952:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745432c6f00) 00010000:00010000:3.0:1782607702.420960:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cbe6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607702.420972:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cbe6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607702.420982:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cbe6f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607702.421021:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782607702.421095:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+36:2357:x1869199342391552:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 445us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607702.421105:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 74 00010000:00010000:1.0:1782607702.421173:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cbe6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607702.421183:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cbe6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607702.421221:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cbe6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607702.421230:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cbe6f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607702.421237:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cbe6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607702.421245:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d649200 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607702.421258:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cbe6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607702.421267:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cbe6f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607702.421277:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745432c6f00) 00010000:00010000:1.0:1782607702.421281:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782607702.421284:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cbe6f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607702.421291:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cbe6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607702.421339:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+35:11538:x1869199342391168:12345-192.168.202.4@tcp:54:lfs.0 Request processed in 12767us (13021us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607702.421349:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 196 00000100:00100000:1.0:1782607702.425050:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607702.425176:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342391808 00000100:00100000:2.0:1782607702.425189:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342391808 00000100:00100000:2.0:1782607702.425280:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 53 00000100:00100000:2.0:1782607702.425292:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+35:11538:x1869199342391808:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:2.0:1782607702.425816:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+36:11538:x1869199342391808:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 523us (781us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1782607702.425826:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 53 00000100:00100000:0.0:1782607702.526943:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607702.527085:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342392064 00000100:00100000:2.0:1782607702.527098:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342392064 00000100:00100000:2.0:1782607702.527177:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 197 00000100:00100000:2.0:1782607702.527189:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+36:11549:x1869199342392064:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:2.0:1782607702.527222:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607702.527250:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cbe76 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629fffab expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.527367:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbe7d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.527386:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbe7d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.527401:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbe7d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.527419:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbe84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.527427:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbe84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.527435:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbe84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.527899:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbe8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.527929:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbe8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.527938:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbe8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782607702.527953:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1782607702.528078:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbe7d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.528087:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbe7d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.528095:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbe7d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.528101:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974541549a00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607702.528107:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbe7d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.528116:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbe7d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.528131:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97454be19200) 00010000:00010000:2.0:1782607702.528134:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607702.528139:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbe7d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.528147:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbe7d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.528162:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbe84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.528174:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbe84 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.528180:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbe84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.528186:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974541548a00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607702.528189:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbe84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.528195:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbe84 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.528203:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9745432c6600) 00010000:00010000:2.0:1782607702.528205:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607702.528209:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbe84 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.528214:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbe84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.528271:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ada00/0x8109266df35cbe76 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffab expref: 39 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.528287:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbe8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffab expref: 38 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.528295:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745432c6f00) 00010000:00010000:2.0:1782607702.528298:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782607702.528306:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974541548c00, rc 0) 00000100:00100000:2.0:1782607702.528417:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+38:11549:x1869199342392064:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1229us (1490us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1782607702.528427:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 197 00000100:00100000:3.0:1782607702.533675:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607702.533811:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342392320 00000100:00100000:1.0:1782607702.533824:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342392320 00000100:00100000:1.0:1782607702.533895:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 54 00000100:00100000:1.0:1782607702.533917:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458153aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+38:11549:x1869199342392320:12345-192.168.202.4@tcp:35:cat.0 00000100:00100000:1.0:1782607702.534239:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458153aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+39:11549:x1869199342392320:12345-192.168.202.4@tcp:35:cat.0 Request processed in 334us (579us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1782607702.534249:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 54 00000100:00100000:3.0:1782607702.553521:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607702.553702:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342392576 00000100:00100000:0.0:1782607702.553716:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342392576 00000100:00100000:0.0:1782607702.553844:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 198 00000100:00100000:0.0:1782607702.553858:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457ff1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+39:11550:x1869199342392576:12345-192.168.202.4@tcp:36:rm.0 00010000:00010000:0.0:1782607702.553955:0:7437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1782607702.553991:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbe8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffab expref: 39 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.554019:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad000/0x8109266df35cbe61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffa4 expref: 38 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.554033:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbe29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff96 expref: 37 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.554046:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9745432c6f00) 00010000:00010000:0.0:1782607702.554071:0:7437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782607702.554099:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbe99 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.554115:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbe99 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.554126:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbe99 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.554164:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbea0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.554172:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbea0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.554180:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbea0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.554566:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbea7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.554575:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbea7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.554582:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbea7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782607702.555337:0:7437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:0.0:1782607702.555348:0:7437:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 361401581991ns, next at 362401578981ns, rc = 0 00010000:00010000:0.0:1782607702.555413:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbeae lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.555426:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbeae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.555434:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbeae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.555443:0:7437:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbeae lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.555461:0:7437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbeae lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.555469:0:7437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbeae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.555492:0:7437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782607702.555518:0:7437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbea7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.555525:0:7437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbea7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.555532:0:7437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbea7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.555538:0:7437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42000 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607702.555544:0:7437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbea7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.555554:0:7437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbea7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.555565:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97454be19f00) 00010000:00010000:0.0:1782607702.555569:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782607702.555573:0:7437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbea7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.555579:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbea7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.555599:0:7437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbe99 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.555614:0:7437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbe99 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.555619:0:7437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbe99 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.555625:0:7437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42600 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607702.555628:0:7437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbe99 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.555635:0:7437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbe99 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.555643:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97454be19200) 00010000:00010000:0.0:1782607702.555646:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782607702.555649:0:7437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbe99 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.555654:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbe99 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782607702.555665:0:7437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a3f36f84 reply state 0000000045b4d327 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbea0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607702.555674:0:7437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782607702.555822:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457ff1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+38:11550:x1869199342392576:12345-192.168.202.4@tcp:36:rm.0 Request processed in 1963us (2315us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1782607702.555833:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 198 00010000:00010000:2.0:1782607702.557113:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782607702.557126:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbeae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.557137:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42c00 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:2.0:1782607702.557141:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbeae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.557151:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbeae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.557169:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97454be19f00) 00010000:00010000:2.0:1782607702.557172:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782607702.557177:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbeae lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.557184:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbeae lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.557207:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607702.557210:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607702.557211:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607702.560713:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbea0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607702.560739:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbea0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607702.560810:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbea0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607702.560818:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42200 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:3.0:1782607702.560824:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbea0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607702.560834:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbea0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607702.560857:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97454be19c00) 00010000:00010000:3.0:1782607702.560860:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782607702.560866:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbea0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607702.560872:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbea0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607702.631380:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607702.631632:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342392832 00000100:00100000:2.0:1782607702.631646:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342392832 00000100:00100000:2.0:1782607702.631725:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 199 00000100:00100000:2.0:1782607702.631737:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457ff1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+37:11556:x1869199342392832:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:2.0:1782607702.631819:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607702.631865:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbeb5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629fffb2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.632064:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbebc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.632082:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbebc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.632096:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbebc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.632116:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbec3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.632124:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbec3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.632130:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbec3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782607702.632847:0:5804:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1782607702.633078:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbeca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.633089:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbeca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.633098:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbeca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.633146:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbebc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.633167:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbebc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.633175:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbebc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.633181:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974541549a00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607702.633186:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbebc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.633195:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbebc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.633211:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97454be19200) 00010000:00010000:2.0:1782607702.633214:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607702.633220:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbebc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.633225:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbebc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782607702.633243:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c9377704 reply state 0000000010066494 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbec3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607702.633254:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782607702.633295:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbeb5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffb2 expref: 40 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.633313:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbeca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffb2 expref: 39 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.633331:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9745432c6c00) 00010000:00010000:2.0:1782607702.633334:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782607702.633337:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974541548c00, rc 0) 00000100:00100000:2.0:1782607702.633439:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457ff1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+40:11556:x1869199342392832:12345-192.168.202.4@tcp:101:bash.0 Request processed in 1704us (2074us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1782607702.633450:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 199 00010000:00010000:1.0:1782607702.639049:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbec3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607702.639073:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbec3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607702.639104:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbec3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607702.639111:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974541548e00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607702.639117:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbec3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607702.639126:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbec3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607702.639147:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9745432c6600) 00010000:00010000:1.0:1782607702.639151:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607702.639156:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbec3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607702.639163:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbec3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607702.646042:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607702.647106:0:9088:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342392960 00000100:00100000:2.0:1782607702.647125:0:9088:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342392960 00000100:00100000:2.0:1782607702.647214:0:9088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 60 00000100:00100000:2.0:1782607702.647227:0:9088:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2356:x1869199342392960:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:2.0:1782607702.647252:0:9088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607702.647280:0:9088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0906959/0x8109266df35cbed8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629fffb9 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782607702.647316:0:9088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782607702.647347:0:9088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=361s v=(0 0) 00010000:00010000:2.0:1782607702.647354:0:9088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782607702.647367:0:9088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0906959/0x8109266df35cbed8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffb9 expref: 6 pid: 9088 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.647404:0:9088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f0906959/0x8109266df35cbed8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffb9 expref: 6 pid: 9088 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.647421:0:9088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974541548a00, rc 0) 00000100:00100000:2.0:1782607702.647508:0:9088:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2356:x1869199342392960:12345-192.168.202.4@tcp:101:bash.0 Request processed in 283us (1481us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607702.647539:0:9088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 60 00000100:00100000:0.0:1782607702.653360:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607702.653525:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342393088 00000100:00100000:3.0:1782607702.653539:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342393088 00000100:00100000:3.0:1782607702.653618:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 61 00000100:00100000:3.0:1782607702.653632:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:11556:x1869199342393088:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:3.0:1782607702.653658:0:6609:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607702.653681:0:6609:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f33008e/0x8109266df35cbedf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629fffc0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607702.653723:0:6609:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f0906959/0x8109266df35cbed8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffb9 expref: 7 pid: 9088 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607702.653760:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782607702.653817:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782607702.653825:0:6609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f33008e/0x8109266df35cbedf lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffc0 expref: 7 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607702.653876:0:6609:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f0906959/0x8109266df35cbed8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffb9 expref: 7 pid: 9088 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607702.653894:0:6609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f0906959/0x8109266df35cbed8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffb9 expref: 7 pid: 9088 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607702.653923:0:6609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457ff1df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6609:1869199364406016:192.168.202.4@tcp:104: 00000100:00100000:3.0:1782607702.654045:0:6609:0:(client.c:2701:ptlrpc_set_wait()) set ffff974442a7c480 going to sleep for 11 seconds 00000100:00100000:0.0:1782607702.662681:0:6609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457ff1df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6609:1869199364406016:192.168.202.4@tcp:104: 00010000:00010000:0.0:1782607702.662761:0:6609:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009f33008e/0x8109266df35cbedf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffc0 expref: 7 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.662843:0:6609:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97455d649a00, rc 0) 00000100:00100000:0.0:1782607702.662941:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:11556:x1869199342393088:12345-192.168.202.4@tcp:101:bash.0 Request processed in 9310us (9593us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607702.662952:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 61 00000100:00100000:3.0:1782607702.670437:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607702.673312:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342393216 00000100:00100000:0.0:1782607702.673348:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342393216 00010000:00010000:0.0:1782607702.673425:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f0906959/0x8109266df35cbed8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffb9 expref: 7 pid: 9088 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607702.673491:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 75 00000100:00100000:0.0:1782607702.673504:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457ff1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:2357:x1869199342393216:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782607702.673528:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782607702.673564:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f0906959/0x8109266df35cbed8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffb9 expref: 7 pid: 9088 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.673583:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f0906959/0x8109266df35cbed8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffb9 expref: 7 pid: 9088 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.673615:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0906959/0x8109266df35cbed8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffb9 expref: 7 pid: 9088 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.673639:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607702.673644:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607702.673672:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009f33008e/0x8109266df35cbedf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffc0 expref: 6 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.673684:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f33008e/0x8109266df35cbedf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffc0 expref: 6 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.673737:0:5787:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009f33008e/0x8109266df35cbedf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffc0 expref: 6 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607702.673756:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676eb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5787:1869199364406144:192.168.202.4@tcp:105: 00000100:00100000:0.0:1782607702.673963:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745509bf9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782607702.681538:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676eb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5787:1869199364406144:192.168.202.4@tcp:105: 00010000:00010000:0.0:1782607702.681586:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782607702.681685:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457ff1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2357:x1869199342393216:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 8181us (11263us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607702.681699:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 75 00000100:00100000:3.0:1782607702.682242:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607702.682435:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342393472 00000100:00100000:2.0:1782607702.682446:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342393472 00000100:00100000:2.0:1782607702.682516:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 55 00000100:00100000:2.0:1782607702.682528:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+39:11556:x1869199342393472:12345-192.168.202.4@tcp:35:bash.0 00000100:00100000:2.0:1782607702.683036:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+40:11556:x1869199342393472:12345-192.168.202.4@tcp:35:bash.0 Request processed in 508us (803us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1782607702.683045:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 55 00000100:00100000:3.0:1782607702.937096:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607702.937226:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342393600 00000100:00100000:0.0:1782607702.937237:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342393600 00000100:00100000:0.0:1782607702.937299:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 200 00000100:00100000:0.0:1782607702.937311:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745675f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+40:11572:x1869199342393600:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1782607702.937353:0:7437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607702.937375:0:7437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbee6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629fffc7 expref: -99 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.937461:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbeed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.937488:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbeed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.937500:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbeed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782607702.937563:0:7437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1782607702.937567:0:7437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1782607702.937591:0:7437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbeed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.937619:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbee6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffc7 expref: 42 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.937639:0:7437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbeed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffc7 expref: 41 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.937648:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97454be19200) 00010000:00010000:0.0:1782607702.937651:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782607702.937655:0:7437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c42000, rc 0) 00000100:00100000:0.0:1782607702.937733:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745675f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+41:11572:x1869199342393600:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 424us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607702.937741:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 200 00000100:00100000:3.0:1782607702.958574:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607702.961370:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342393856 00000100:00100000:2.0:1782607702.961386:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342393856 00000100:00100000:2.0:1782607702.961472:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 201 00000100:00100000:2.0:1782607702.961483:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745675f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+41:11572:x1869199342393856:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1782607702.961504:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607702.961525:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbef4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629fffce expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.961630:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbefb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.961645:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbefb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.961656:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbefb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782607702.961684:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1782607702.962195:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbef4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffce expref: 44 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.962237:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbefb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffce expref: 43 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.962244:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9745432c6c00) 00010000:00010000:2.0:1782607702.962247:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782607702.962250:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974541548a00, rc 0) 00000100:00100000:2.0:1782607702.962326:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745675f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+43:11572:x1869199342393856:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 845us (3763us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1782607702.962334:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 201 00000100:00100000:3.0:1782607702.973138:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607702.973253:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607702.973374:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342394112 00000100:00100000:0.0:1782607702.973393:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342394112 00000100:00100000:0.0:1782607702.973471:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 202 00000100:00100000:0.0:1782607702.973482:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745675f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+43:11572:x1869199342394112:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1782607702.973509:0:7437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607702.973546:0:7437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbf09 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629fffd5 expref: -99 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.973650:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cbf10 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.973683:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cbf10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.973695:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cbf10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782607702.973709:0:7437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1782607702.975172:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbf09 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffd5 expref: 46 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.975204:0:7437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cbf10 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffd5 expref: 45 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607702.975214:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9745432c6c00) 00010000:00010000:0.0:1782607702.975217:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1782607702.975220:0:7437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c43400, rc 0) 00000100:00100000:0.0:1782607702.975304:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745675f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+45:11572:x1869199342394112:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 1823us (2174us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1782607702.975312:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 202 00000100:00100000:1.0:1782607702.982418:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342394240 00000100:00100000:1.0:1782607702.982432:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342394240 00000100:00100000:1.0:1782607702.982568:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 14 00000100:00100000:1.0:1782607702.982579:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455109dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+45:2356:x1869199342394240:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782607702.982596:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782607702.982623:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbefb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffce expref: 45 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607702.982645:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9745432c6c00) 00010000:00010000:1.0:1782607702.982678:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782607702.982758:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455109dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+44:2356:x1869199342394240:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 180us (9504us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607702.982790:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 14 00000100:00100000:3.0:1782607702.988972:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607702.989084:0:9088:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342394368 00000100:00100000:2.0:1782607702.989095:0:9088:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342394368 00000100:00100000:2.0:1782607702.989160:0:9088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 62 00000100:00100000:2.0:1782607702.989170:0:9088:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745675f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+6:2355:x1869199342394368:12345-192.168.202.4@tcp:1:lfs.0 00010000:00010000:2.0:1782607702.989216:0:9088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d96479ad/0x8109266df35cbf1e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.989237:0:9088:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009f33008e/0x8109266df35cbedf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffc0 expref: 6 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.989245:0:9088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782607702.989249:0:9088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782607702.989253:0:9088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d96479ad/0x8109266df35cbf1e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.989287:0:9088:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009f33008e/0x8109266df35cbedf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffc0 expref: 6 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607702.989316:0:9088:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009f33008e/0x8109266df35cbedf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffc0 expref: 6 pid: 6609 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607702.989332:0:9088:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974443760380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9088:1869199364406272:192.168.202.4@tcp:104: 00000100:00100000:2.0:1782607702.989427:0:9088:0:(client.c:2701:ptlrpc_set_wait()) set ffff97457f49e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782607703.002745:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607703.003743:0:9088:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974443760380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9088:1869199364406272:192.168.202.4@tcp:104: 00010000:00010000:1.0:1782607703.003802:0:9088:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d96479ad/0x8109266df35cbf1e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607703.004199:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342394496 00000100:00100000:3.0:1782607703.004217:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342394496 00002000:00100000:3.0:1782607703.004302:0:6616:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff974443761180 x1869199342394496/t0(0) o4->d72d7fb9-639f-4ad9-b658-df715cbf7792@192.168.202.4@tcp:619/0 lens 504/0 e 0 to 0 dl 1782607714 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782607703.004314:0:6616:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974443761180 with x1869199342394496 ext(0->8) 00010000:00010000:3.0:1782607703.004345:0:6616:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009f33008e/0x8109266df35cbedf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffc0 expref: 7 pid: 6609 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607703.004366:0:6616:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009f33008e/0x8109266df35cbedf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffc0 expref: 7 pid: 6609 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782607703.004375:0:6616:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff974443761180 00000100:00100000:3.0:1782607703.004454:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2 00000100:00100000:3.0:1782607703.004467:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443761180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:2357:x1869199342394496:12345-192.168.202.4@tcp:4:lfs.0 00000100:00100000:3.0:1782607703.005416:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443761180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+9:2357:x1869199342394496:12345-192.168.202.4@tcp:4:lfs.0 Request processed in 947us (2678us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1782607703.005427:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2 00002000:00100000:3.0:1782607703.005437:0:6616:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff974443761180 x1869199342394496/t4294967308(0) o4->d72d7fb9-639f-4ad9-b658-df715cbf7792@192.168.202.4@tcp:619/0 lens 504/448 e 0 to 0 dl 1782607714 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782607703.005446:0:6616:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff974443761180 with x1869199342394496 ext(0->8) 00010000:00010000:3.0:1782607703.005454:0:6616:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009f33008e/0x8109266df35cbedf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffc0 expref: 9 pid: 6609 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607703.005469:0:6616:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009f33008e/0x8109266df35cbedf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffc0 expref: 9 pid: 6609 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782607703.005476:0:6616:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff974443761180 00000100:00100000:3.0:1782607703.014676:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607703.014819:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342394624 00000100:00100000:0.0:1782607703.014836:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342394624 00010000:00010000:0.0:1782607703.014899:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009f33008e/0x8109266df35cbedf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffc0 expref: 9 pid: 6609 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607703.014993:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 76 00000100:00100000:0.0:1782607703.015003:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745675f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+9:2357:x1869199342394624:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782607703.015020:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1782607703.015050:0:5787:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1782607703.015053:0:5787:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1782607703 00002000:00010000:0.0:1782607703.015055:0:5787:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1782607703 00002000:00010000:0.0:1782607703.015058:0:5787:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1782607703 00010000:00010000:0.0:1782607703.015065:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009f33008e/0x8109266df35cbedf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffc0 expref: 9 pid: 6609 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607703.015079:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009f33008e/0x8109266df35cbedf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffc0 expref: 9 pid: 6609 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607703.015102:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f33008e/0x8109266df35cbedf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffc0 expref: 9 pid: 6609 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607703.015119:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782607703.015123:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782607703.015129:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d96479ad/0x8109266df35cbf1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607703.015139:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d96479ad/0x8109266df35cbf1e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607703.015183:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782607703.015220:0:9088:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d96479ad/0x8109266df35cbf1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.015230:0:9088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d96479ad/0x8109266df35cbf1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.015253:0:9088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d96479ad/0x8109266df35cbf1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607703.015256:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745675f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+8:2357:x1869199342394624:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 255us (593us total) trans 0 rc 0/0 00010000:00010000:1.0:1782607703.015262:0:9088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d96479ad/0x8109266df35cbf1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607703.015264:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 76 00010000:00010000:1.0:1782607703.015339:0:9088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d96479ad/0x8109266df35cbf1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.015348:0:9088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974541548e00 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:1.0:1782607703.015352:0:9088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d96479ad/0x8109266df35cbf1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.015372:0:9088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d96479ad/0x8109266df35cbf1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.015384:0:9088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d96479ad/0x8109266df35cbf1e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.015392:0:9088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d96479ad/0x8109266df35cbf1e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607703.015508:0:9088:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745675f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:2355:x1869199342394368:12345-192.168.202.4@tcp:1:lfs.0 Request processed in 26339us (26545us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607703.015517:0:9088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 62 00000100:00100000:1.0:1782607703.019804:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607703.019886:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342394880 00000100:00100000:2.0:1782607703.019897:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342394880 00000100:00100000:2.0:1782607703.019987:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 56 00000100:00100000:2.0:1782607703.019998:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549b89450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+44:11572:x1869199342394880:12345-192.168.202.4@tcp:35:lfs.0 00000004:00010000:2.0:1782607703.020074:0:5807:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cbf10 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffd5 expref: 44 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782607703.020338:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1782607703.020385:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1782607703.021009:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1782607703.021066:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbf25 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.021082:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbeca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffb2 expref: 48 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.021091:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbf25 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.021982:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbeca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffb2 expref: 48 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.022020:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbeca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffb2 expref: 48 pid: 5804 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607703.022047:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974443762680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5807:1869199364406400:192.168.202.4@tcp:104: 00000100:00100000:2.0:1782607703.022144:0:5807:0:(client.c:2701:ptlrpc_set_wait()) set ffff97457f49eb40 going to sleep for 11 seconds 00000100:00080000:3.0:1782607703.022531:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782607703.045435:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607703.046214:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342395008 00000100:00100000:3.0:1782607703.046225:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342395008 00010000:00010000:3.0:1782607703.046282:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbeca lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffb2 expref: 49 pid: 5804 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607703.046318:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 77 00000100:00100000:3.0:1782607703.046328:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443761880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+49:2356:x1869199342395008:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782607703.046344:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782607703.046352:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbeca lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffb2 expref: 49 pid: 5804 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607703.046364:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbeca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffb2 expref: 49 pid: 5804 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607703.046387:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9745432c6c00) 00010000:00010000:3.0:1782607703.046393:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbf25 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607703.046403:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbf25 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607703.046410:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbf25 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607703.046431:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782607703.046485:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443761880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+49:2356:x1869199342395008:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 156us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607703.046493:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 77 00010000:00010000:1.0:1782607703.055012:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbeca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffb2 expref: 48 pid: 5804 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607703.055871:0:5807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974443762680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5807:1869199364406400:192.168.202.4@tcp:104: 00010000:00010000:1.0:1782607703.055899:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbf25 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.055922:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbf25 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.055926:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbf25 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782607703.056317:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1782607703.057589:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:1.0:1782607703.059457:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f4b8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5807:1869199364406528:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1782607703.059530:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607703.059628:0:5807:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745411b79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782607703.061467:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364406528 00000100:00100000:3.0:1782607703.061481:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364406528 00000100:00100000:3.0:1782607703.061601:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782607703.061626:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5807:x1869199364406528:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1782607703.061757:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5807:x1869199364406528:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 134us (2226us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607703.061780:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782607703.061952:0:5807:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:2.0:1782607703.061960:0:5807:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97455d461180, transno 4294967307 00000100:00100000:2.0:1782607703.061983:0:5807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f4b8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5807:1869199364406528:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1782607703.062569:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1782607703.062661:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974443762a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5807:1869199364406656:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1782607703.062711:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607703.062749:0:12340:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364406656 00000100:00100000:2.0:1782607703.062755:0:12340:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364406656 00000100:00100000:2.0:1782607703.063492:0:12340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782607703.063504:0:12340:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5807:x1869199364406656:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1782607703.063707:0:12340:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5807:x1869199364406656:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 205us (995us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1782607703.063714:0:12340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782607703.063739:0:5807:0:(client.c:2701:ptlrpc_set_wait()) set ffff97457f49e240 going to sleep for 11 seconds 00000100:00100000:2.0:1782607703.064619:0:5807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974443762a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5807:1869199364406656:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1782607703.064703:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1782607703.064752:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbf25 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.067637:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbf25 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.067646:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbf25 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.067653:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974541549a00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607703.067668:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbf25 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.067678:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbf25 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.067698:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9745432c6c00) 00010000:00010000:2.0:1782607703.067701:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1782607703.067706:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbf25 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.067713:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbf25 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1782607703.069006:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1782607703.069275:0:5807:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1782607703.069449:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1782607703.069464:0:5807:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 361915697719ns, next at 362915693774ns, rc = 0 00000001:00080000:2.0:1782607703.069474:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1782607703.069532:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9745432c6c00) 00010000:00010000:2.0:1782607703.069536:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1782607703.069547:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cbf10 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffd5 expref: 52 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607703.070125:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549b89450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+51:11572:x1869199342394880:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 50126us (50327us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1782607703.070135:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 56 00000020:00080000:2.0:1782607703.070141:0:5807:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1782607703.079725:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607703.080006:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342395136 00000100:00100000:0.0:1782607703.080016:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342395136 00000100:00100000:0.0:1782607703.080096:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 203 00000100:00100000:0.0:1782607703.080108:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443762300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+51:11572:x1869199342395136:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1782607703.080133:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607703.080157:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cbf2c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629fffdc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607703.080224:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cbf2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffdc expref: 52 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607703.080241:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cbf2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffdc expref: 52 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607703.080260:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97454be19300) 00010000:00010000:0.0:1782607703.080263:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782607703.080267:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c43400, rc 0) 00000100:00100000:0.0:1782607703.080345:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443762300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+52:11572:x1869199342395136:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 229us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607703.080354:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 203 00000100:00100000:0.0:1782607703.097394:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607703.097492:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342395392 00000100:00100000:1.0:1782607703.097501:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342395392 00000100:00100000:1.0:1782607703.097558:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 57 00000100:00100000:1.0:1782607703.097569:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+52:11572:x1869199342395392:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:1.0:1782607703.097871:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+53:11572:x1869199342395392:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 302us (486us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1782607703.097880:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 57 00000100:00100000:0.0:1782607703.106305:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f4b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364406784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782607703.106385:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607703.106639:0:6613:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364406784 00000100:00100000:1.0:1782607703.106646:0:6613:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364406784 00000100:00100000:1.0:1782607703.106932:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1782607703.106943:0:6613:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1869199364406784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782607703.106969:0:6613:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782607703.107288:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f4b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364406784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782607703.107892:0:6613:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1869199364406784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607703.107902:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1782607703.212481:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607703.212655:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342395520 00000100:00100000:2.0:1782607703.212666:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342395520 00000100:00100000:2.0:1782607703.212744:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 204 00000100:00100000:2.0:1782607703.212754:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745675f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+53:11582:x1869199342395520:12345-192.168.202.4@tcp:34:lfs.0 00010000:00010000:2.0:1782607703.212880:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbf33 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.212896:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbf33 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.212919:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbf33 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.212936:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbf3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.212942:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbf3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.212948:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbf3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.213076:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbf41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.213085:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbf41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.213091:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbf41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782607703.213133:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbf41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.213145:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbf33 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.213162:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbf33 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.213169:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbf33 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.213174:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974541549a00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607703.213179:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbf33 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.213187:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbf33 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.213200:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97454be19200) 00010000:00010000:2.0:1782607703.213203:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607703.213207:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbf33 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.213222:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbf33 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.213238:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbf3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.213245:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbf3a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.213250:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbf3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.213255:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974541548c00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607703.213258:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbf3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.213264:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbf3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.213272:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9745432c6c00) 00010000:00010000:2.0:1782607703.213274:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607703.213277:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbf3a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.213283:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbf3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.213306:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbf41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.213313:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbf41 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.213326:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbf41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.213332:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974541548e00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607703.213335:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbf41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.213341:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbf41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.213349:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97454be19300) 00010000:00010000:2.0:1782607703.213351:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607703.213354:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbf41 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.213360:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbf41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607703.214713:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745675f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+53:11582:x1869199342395520:12345-192.168.202.4@tcp:34:lfs.0 Request processed in 1954us (2237us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607703.214722:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 204 00010000:00010000:0.0:1782607703.299043:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782607703.299200:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607703.299333:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342395776 00000100:00100000:0.0:1782607703.299344:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342395776 00000100:00100000:1.0:1782607703.299500:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 205 00000100:00100000:1.0:1782607703.299514:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745675f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+53:11585:x1869199342395776:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1782607703.299537:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607703.299558:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cbf48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629fffe3 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.299658:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cbf4f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.299676:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cbf4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.299686:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cbf4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.299701:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cbf56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.299708:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cbf56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.299715:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cbf56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.300132:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cbf5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.300142:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cbf5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.300285:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cbf5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782607703.300296:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1782607703.300588:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cbf4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.300659:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cbf4f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.300674:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cbf4f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.300680:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f467c00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607703.300685:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cbf4f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.300693:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cbf4f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.300707:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97454be19200) 00010000:00010000:1.0:1782607703.300710:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607703.300715:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cbf4f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.300721:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cbf4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.300735:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cbf56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.300741:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cbf56 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.300747:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cbf56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.300751:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f466400 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607703.300754:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cbf56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.303389:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cbf56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.304951:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff974543e77700) 00010000:00010000:1.0:1782607703.304958:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607703.304966:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cbf56 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.304976:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cbf56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.306396:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cbf48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffe3 expref: 56 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.307529:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cbf5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffe3 expref: 55 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.307541:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97454be19300) 00010000:00010000:1.0:1782607703.307544:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782607703.307547:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97457f467e00, rc 0) 00000100:00100000:1.0:1782607703.308399:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745675f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+55:11585:x1869199342395776:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 8884us (9201us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1782607703.309652:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 205 00000100:00100000:1.0:1782607703.325488:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607703.325756:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342395904 00000100:00100000:2.0:1782607703.325816:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342395904 00000100:00100000:2.0:1782607703.325880:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 206 00000100:00100000:2.0:1782607703.325891:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+55:11585:x1869199342395904:12345-192.168.202.4@tcp:54:lfs.0 00010000:00010000:2.0:1782607703.325976:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbf6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.325995:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbf6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.326021:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbf6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.326330:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbf6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.326337:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbf6b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.326344:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbf6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.326350:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974541548e00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607703.326355:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbf6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.326363:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbf6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.326376:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97454be19300) 00010000:00010000:2.0:1782607703.326380:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782607703.326385:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbf6b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.326392:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbf6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607703.326488:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+55:11585:x1869199342395904:12345-192.168.202.4@tcp:54:lfs.0 Request processed in 597us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607703.326497:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 206 00000100:00100000:3.0:1782607703.335623:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607703.335835:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342396160 00000100:00100000:1.0:1782607703.335846:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342396160 00000100:00100000:1.0:1782607703.335917:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 58 00000100:00100000:1.0:1782607703.335928:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745675f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+55:11585:x1869199342396160:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:1.0:1782607703.336523:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745675f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+56:11585:x1869199342396160:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 595us (908us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1782607703.336532:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 58 00000100:00100000:3.0:1782607703.457194:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607703.457909:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342396416 00000100:00100000:0.0:1782607703.457920:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342396416 00000100:00100000:0.0:1782607703.458049:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 207 00000100:00100000:0.0:1782607703.458060:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745675f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+56:11595:x1869199342396416:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:0.0:1782607703.458092:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607703.458096:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1782607703.458124:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbeed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffc7 expref: 56 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607703.458143:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97454be19200) 00010000:00010000:0.0:1782607703.458148:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782607703.458161:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbf72 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629fffea expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607703.458301:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbf79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607703.458329:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbf79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607703.458339:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbf79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782607703.458349:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1782607703.458487:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cbf72 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffea expref: 58 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607703.458501:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbf79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffea expref: 57 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607703.458516:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97454be19300) 00010000:00010000:0.0:1782607703.458518:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782607703.458521:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c42200, rc 0) 00000100:00100000:0.0:1782607703.458602:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745675f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+57:11595:x1869199342396416:12345-192.168.202.4@tcp:101:bash.0 Request processed in 543us (1416us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1782607703.458609:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 207 00000100:00100000:0.0:1782607703.471194:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607703.471341:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342396672 00000100:00100000:2.0:1782607703.471367:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342396672 00000100:00100000:2.0:1782607703.471560:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 208 00000100:00100000:2.0:1782607703.471572:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+57:11595:x1869199342396672:12345-192.168.202.4@tcp:36:bash.0 00010000:00010000:2.0:1782607703.471670:0:7437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782607703.471701:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cbf79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffea expref: 57 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.471723:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467e00/0x8109266df35cbf5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffe3 expref: 56 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.471732:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97454be19300) 00010000:00010000:2.0:1782607703.471737:0:7437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782607703.472185:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbf87 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.472201:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbf87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.472210:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbf87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782607703.472260:0:7437:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1782607703.472285:0:7437:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008fded603 reply state 00000000462c506c transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbf87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607703.472294:0:7437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782607703.472570:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+58:11595:x1869199342396672:12345-192.168.202.4@tcp:36:bash.0 Request processed in 998us (1384us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1782607703.472578:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 208 00000020:00080000:2.0:1782607703.472583:0:7437:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1782607703.477513:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbf87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.477532:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbf87 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.477723:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbf87 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.477731:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974541548e00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607703.477735:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbf87 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.477744:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbf87 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.478001:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97454be19300) 00010000:00010000:1.0:1782607703.478005:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607703.478011:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbf87 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.478018:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbf87 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607703.483179:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607703.483288:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342396800 00000100:00100000:1.0:1782607703.483299:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342396800 00000100:00100000:1.0:1782607703.483378:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 209 00000100:00100000:1.0:1782607703.483388:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745675f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+57:11595:x1869199342396800:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:1.0:1782607703.483431:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607703.483452:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cbf8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffff1 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.483539:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cbf95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.483552:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cbf95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.483575:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cbf95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782607703.483615:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1782607703.483619:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782607703.483638:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cbf95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.483664:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cbf8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffff1 expref: 59 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.484114:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cbf95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffff1 expref: 58 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.484123:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97454be19300) 00010000:00010000:1.0:1782607703.484125:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782607703.484129:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97457f466400, rc 0) 00000100:00100000:1.0:1782607703.484208:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745675f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+58:11595:x1869199342396800:12345-192.168.202.4@tcp:101:bash.0 Request processed in 821us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607703.484215:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 209 00000100:00100000:2.0:1782607703.493159:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607703.493290:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342397056 00000100:00100000:3.0:1782607703.493300:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342397056 00000100:00100000:3.0:1782607703.493365:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 59 00000100:00100000:3.0:1782607703.493375:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+58:11595:x1869199342397056:12345-192.168.202.4@tcp:35:bash.0 00000100:00100000:3.0:1782607703.494059:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+59:11595:x1869199342397056:12345-192.168.202.4@tcp:35:bash.0 Request processed in 683us (908us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1782607703.494069:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 59 00000100:00100000:3.0:1782607703.613016:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607703.613866:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342397184 00000100:00100000:1.0:1782607703.613882:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342397184 00000100:00100000:1.0:1782607703.614024:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 210 00000100:00100000:1.0:1782607703.614037:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745675f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+59:11601:x1869199342397184:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1782607703.614073:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607703.614100:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cbf9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629ffff8 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.614203:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cbfa3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.614221:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cbfa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.614235:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cbfa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782607703.614644:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1782607703.614650:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1782607703.614681:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cbfa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.614714:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cbf9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffff8 expref: 61 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.614739:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cbfa3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffff8 expref: 60 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.614749:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97454be19200) 00010000:00010000:1.0:1782607703.614753:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782607703.614836:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97457f466a00, rc 0) 00000100:00100000:1.0:1782607703.614935:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745675f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+60:11601:x1869199342397184:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 900us (2170us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607703.614943:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 210 00000100:00100000:1.0:1782607703.621822:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607703.621980:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342397312 00000100:00100000:2.0:1782607703.621994:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342397312 00000100:00100000:2.0:1782607703.622072:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 211 00000100:00100000:2.0:1782607703.622085:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+60:11601:x1869199342397312:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1782607703.622116:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607703.622143:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbfaa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b58629fffff expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.622236:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbfb1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.622255:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbfb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.622269:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbfb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.622289:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbfb8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.622296:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbfb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.622303:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbfb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.622454:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbfbf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.622464:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbfbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.622495:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbfbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782607703.622542:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1782607703.622547:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782607703.622570:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbfbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.622585:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbfbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.622595:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbfb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.622601:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbfb1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.622608:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbfb1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.622613:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974541549a00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607703.622618:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbfb1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.622627:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbfb1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.622641:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97454be19200) 00010000:00010000:2.0:1782607703.622644:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607703.622650:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbfb1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.622666:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbfb1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.622682:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbfb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.622688:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbfb8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.622694:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbfb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.622698:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974541548a00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607703.622702:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbfb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.622708:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbfb8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.622715:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9745432c6c00) 00010000:00010000:2.0:1782607703.622717:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607703.622719:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbfb8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.622725:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbfb8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.628008:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbfaa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffff expref: 62 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.628061:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbfbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffff expref: 61 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.628129:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97454be19300) 00010000:00010000:2.0:1782607703.628132:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782607703.628137:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974541548e00, rc 0) 00000100:00100000:2.0:1782607703.628247:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+61:11601:x1869199342397312:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 6162us (6437us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607703.628258:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 211 00000100:00100000:3.0:1782607703.644413:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607703.644471:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607703.644506:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342397696 00000100:00100000:0.0:1782607703.644515:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342397568 00000100:00100000:3.0:1782607703.644520:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342397696 00000100:00100000:0.0:1782607703.644520:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342397568 00000100:00100000:3.0:1782607703.644586:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15 00000100:00100000:0.0:1782607703.644592:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 212 00000100:00100000:3.0:1782607703.644598:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745675f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+62:2356:x1869199342397696:12345-192.168.202.4@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1782607703.644598:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745675f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+62:11601:x1869199342397568:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1782607703.644619:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782607703.644621:0:7437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607703.644643:0:7437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbfc6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b5862a00006 expref: -99 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607703.644650:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbfbf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffff expref: 62 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607703.644691:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97454be19300) 00010000:00010000:3.0:1782607703.644698:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782607703.644805:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745675f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+62:2356:x1869199342397696:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 208us (332us total) trans 0 rc 0/0 00010000:00010000:0.0:1782607703.644812:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbfcd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607703.644814:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15 00010000:00010000:0.0:1782607703.644827:0:7437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cbf95 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffff1 expref: 62 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607703.644837:0:7437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbfcd lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607703.644877:0:7437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cbf95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffff1 expref: 61 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607703.644919:0:7437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cbf95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffff1 expref: 61 pid: 5803 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607703.644937:0:7437:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676eb800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7437:1869199364406912:192.168.202.4@tcp:104: 00000100:00100000:0.0:1782607703.645017:0:7437:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745509bf000 going to sleep for 11 seconds 00000100:00100000:2.0:1782607703.653205:0:7437:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676eb800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7437:1869199364406912:192.168.202.4@tcp:104: 00010000:00010000:2.0:1782607703.653237:0:7437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbfcd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607703.658919:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607703.659047:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342397824 00000100:00100000:2.0:1782607703.659067:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342397824 00010000:00010000:2.0:1782607703.659117:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cbf95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffff1 expref: 62 pid: 5803 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607703.659170:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 78 00000100:00100000:2.0:1782607703.659183:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+62:2355:x1869199342397824:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782607703.659201:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782607703.659210:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cbf95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffff1 expref: 62 pid: 5803 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.659226:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cbf95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffff1 expref: 62 pid: 5803 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.659253:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466400/0x8109266df35cbf95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffff1 expref: 62 pid: 5803 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.659292:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97454be19300) 00010000:00010000:2.0:1782607703.659298:0:5787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbfcd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.659306:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbfcd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.659315:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbfcd lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.659343:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782607703.659420:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+61:2355:x1869199342397824:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 240us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607703.659428:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 78 00010000:00010000:0.0:1782607703.659820:0:7437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbfcd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607703.659831:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbfcd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782607703.659854:0:7437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1782607703.660044:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbfc6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00006 expref: 62 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607703.660121:0:7437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbfcd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00006 expref: 61 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607703.660129:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97454be19300) 00010000:00010000:0.0:1782607703.660132:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782607703.660135:0:7437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c42000, rc 0) 00000100:00100000:0.0:1782607703.660177:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745675f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+61:11601:x1869199342397568:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 15577us (15778us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1782607703.660185:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 212 00000100:00100000:1.0:1782607703.667847:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607703.668004:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342398080 00000100:00100000:3.0:1782607703.668018:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342398080 00000100:00100000:3.0:1782607703.668122:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16 00000100:00100000:3.0:1782607703.668136:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+61:11601:x1869199342398080:12345-192.168.202.4@tcp:103:lfs.0 00010000:00010000:3.0:1782607703.668158:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782607703.668192:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cbf2c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fffdc expref: 61 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607703.668217:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97454be19300) 00010000:00010000:3.0:1782607703.668223:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782607703.668311:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+60:11601:x1869199342398080:12345-192.168.202.4@tcp:103:lfs.0 Request processed in 178us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607703.668320:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16 00000100:00100000:2.0:1782607703.670543:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607703.670676:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342398208 00000100:00100000:1.0:1782607703.670686:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342398208 00000100:00100000:1.0:1782607703.670750:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 213 00000100:00100000:1.0:1782607703.670760:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443761f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+60:11601:x1869199342398208:12345-192.168.202.4@tcp:58:lfs.0 00010000:00010000:1.0:1782607703.670921:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cbfdb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.670937:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cbfdb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607703.670949:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cbfdb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782607703.671331:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1782607703.671480:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443761f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+60:11601:x1869199342398208:12345-192.168.202.4@tcp:58:lfs.0 Request processed in 719us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607703.671488:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 213 00000100:00100000:1.0:1782607703.677649:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607703.679202:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342398336 00000100:00100000:2.0:1782607703.679217:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342398336 00000100:00100000:2.0:1782607703.679295:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 214 00000100:00100000:2.0:1782607703.679307:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+60:11601:x1869199342398336:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1782607703.679328:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607703.679350:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbfe2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b5862a0000d expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.679409:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cbfdb lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.679420:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbfe2 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0000d expref: 61 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.679463:0:5805:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cbfdb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.679477:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbfe2 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0000d expref: 61 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.679491:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97454be19300) 00010000:00010000:2.0:1782607703.679493:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782607703.679497:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbfe2 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0000d expref: 61 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607703.679504:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974541549a00, rc 0) 00000100:00100000:2.0:1782607703.679570:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+61:11601:x1869199342398336:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 266us (1932us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607703.679576:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 214 00000040:00080000:0.0:1782607704.066030:0:11563:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782607704.066040:0:11563:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782607704.066094:0:11563:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1782607704.066115:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782607704.066233:0:11563:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676eb800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11563:1869199364407040:192.168.202.4@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1782607704.066355:0:11563:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745509bf840 going to sleep for 11 seconds 00000100:00100000:0.0:1782607704.069462:0:11563:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676eb800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11563:1869199364407040:192.168.202.4@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782607704.093244:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607704.094479:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342398464 00000100:00100000:2.0:1782607704.094496:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342398464 00000100:00100000:2.0:1782607704.094574:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 215 00000100:00100000:2.0:1782607704.094585:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745675f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+61:11602:x1869199342398464:12345-192.168.202.4@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1782607704.094621:0:5804:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1782607704.094749:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745675f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+61:11602:x1869199342398464:12345-192.168.202.4@tcp:53:lhsmtool_posix.0 Request processed in 165us (1521us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607704.094757:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 215 00000100:00100000:1.0:1782607704.098419:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607704.098514:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342398592 00000100:00100000:2.0:1782607704.098525:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342398592 00000100:00100000:2.0:1782607704.098631:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 216 00000100:00100000:2.0:1782607704.098655:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+61:11602:x1869199342398592:12345-192.168.202.4@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1782607704.098728:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbfe9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.098746:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbfe9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.098758:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbfe9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.098840:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbff0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.098848:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbff0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.098854:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbff0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.098904:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbff7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.098913:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbff7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.098918:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbff7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782607704.098958:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1782607704.098962:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782607704.098974:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbff7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.098996:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbfe9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.099003:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbfe9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.099010:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbfe9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.099016:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974541548c00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607704.099021:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbfe9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.099028:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbfe9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.099042:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97454c8e3f00) 00010000:00010000:2.0:1782607704.099045:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607704.099051:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbfe9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.100226:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541548c00/0x8109266df35cbfe9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.100260:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbff0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.100268:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbff0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.100274:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbff0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.100291:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974541548e00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607704.100295:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbff0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.100302:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbff0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.100313:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9745432c6c00) 00010000:00010000:2.0:1782607704.100315:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607704.100319:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbff0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.100325:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cbff0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.100348:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbff7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.100354:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbff7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.100360:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbff7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.100365:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974541548a00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607704.100368:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbff7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.100374:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbff7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.100391:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97454be19300) 00010000:00010000:2.0:1782607704.100393:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607704.100396:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbff7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.100401:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cbff7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607704.100494:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+61:11602:x1869199342398592:12345-192.168.202.4@tcp:34:lhsmtool_posix.0 Request processed in 1839us (2084us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607704.100504:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 216 00000100:00100000:2.0:1782607704.106304:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607704.106870:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342398848 00000100:00100000:0.0:1782607704.107125:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342398848 00000100:00100000:0.0:1782607704.107197:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 217 00000100:00100000:0.0:1782607704.107208:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443763b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+61:11602:x1869199342398848:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782607704.107229:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607704.107315:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbffe lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b5862a00014 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.107425:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cc005 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.107441:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cc005 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.107454:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cc005 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782607704.107465:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1782607704.107567:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cc005 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.107575:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cc005 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.107582:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cc005 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.107607:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42200 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607704.107612:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cc005 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.107620:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cc005 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.107634:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97454be19300) 00010000:00010000:0.0:1782607704.107637:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782607704.107642:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cc005 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.107648:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cc005 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.107691:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbffe lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00014 expref: 63 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.107702:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97454c8e3f00) 00010000:00010000:0.0:1782607704.107704:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782607704.107708:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cbffe lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00014 expref: 63 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.107718:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c42c00, rc 0) 00000100:00100000:0.0:1782607704.107825:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443763b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+62:11602:x1869199342398848:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 Request processed in 619us (1596us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1782607704.107833:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 217 00000100:00100000:3.0:1782607704.113233:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607704.113491:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342398976 00000100:00100000:0.0:1782607704.113515:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342398976 00000100:00100000:0.0:1782607704.113572:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 218 00000100:00100000:0.0:1782607704.113583:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745675f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+62:11602:x1869199342398976:12345-192.168.202.4@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782607704.113623:0:7437:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782607704.114147:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745675f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+62:11602:x1869199342398976:12345-192.168.202.4@tcp:53:lhsmtool_posix.0 Request processed in 564us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607704.114157:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 218 00000100:00100000:3.0:1782607704.121663:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607704.121810:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342399232 00000100:00100000:0.0:1782607704.121821:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342399232 00000100:00100000:0.0:1782607704.121872:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 219 00000100:00100000:0.0:1782607704.122077:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745675f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+62:11602:x1869199342399232:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782607704.122099:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607704.122102:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1782607704.122130:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cbfa3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffff8 expref: 62 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.122150:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97454be19200) 00010000:00010000:0.0:1782607704.122155:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782607704.122168:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cc013 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b5862a0001b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782607704.122595:0:5804:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:0.0:1782607704.122835:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cc01a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.122849:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cc01a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.123531:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cc01a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.123607:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cc013 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0001b expref: 64 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.123624:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cc01a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0001b expref: 63 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.123632:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97454be19100) 00010000:00010000:0.0:1782607704.123636:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782607704.123639:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c42200, rc 0) 00000100:00100000:0.0:1782607704.123713:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745675f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+63:11602:x1869199342399232:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 Request processed in 1639us (2061us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1782607704.125470:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 219 00000004:00080000:0.0:1782607704.130119:0:6711:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 362976351415ns, next at 363976348804ns, rc = 0 00000100:00100000:2.0:1782607704.130255:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745676eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364407168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782607704.130327:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607704.130467:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364407168 00000100:00100000:0.0:1782607704.130475:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364407168 00000100:00100000:0.0:1782607704.130545:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1782607704.130556:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443761500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1869199364407168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782607704.130591:0:6612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782607704.130632:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443761500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1869199364407168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607704.130639:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1782607704.130699:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782607704.130866:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745676eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364407168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782607704.131557:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607704.131620:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342399488 00000100:00100000:2.0:1782607704.131625:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342399488 00000100:00100000:2.0:1782607704.131665:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 220 00000100:00100000:2.0:1782607704.131673:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745675f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+63:11602:x1869199342399488:12345-192.168.202.4@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1782607704.131721:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782607704.131747:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cc01a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0001b expref: 63 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.135622:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97454be19100) 00010000:00010000:2.0:1782607704.135650:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782607704.135693:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cc028 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.135729:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cc028 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.135741:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cc028 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.135821:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cc02f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x16a96e40 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.135830:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cc02f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x16a96e40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.135837:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cc02f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x16a96e40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.135950:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cc028 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.135958:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cc028 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.135964:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cc028 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.135970:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974541548a00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607704.135975:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cc028 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.135983:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cc028 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.135994:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97454be19200) 00010000:00010000:2.0:1782607704.136003:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607704.136007:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cc028 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.136013:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cc028 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.136026:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cc02f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x16a96e40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.136032:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cc02f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x16a96e40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.136038:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cc02f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x16a96e40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.136043:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974541548e00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607704.136046:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cc02f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x16a96e40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.136051:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cc02f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x16a96e40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.136204:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x16a96e40 (ffff9745432c6c00) 00010000:00010000:2.0:1782607704.136207:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607704.136210:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cc02f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x16a96e40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.136216:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cc02f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x16a96e40 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607704.136447:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745675f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+62:11602:x1869199342399488:12345-192.168.202.4@tcp:36:lhsmtool_posix.0 Request processed in 4769us (4889us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782607704.136465:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 220 00000100:00100000:3.0:1782607704.152189:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607704.152389:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342399616 00000100:00100000:1.0:1782607704.152400:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342399616 00000100:00100000:1.0:1782607704.152504:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 221 00000100:00100000:1.0:1782607704.152515:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745675f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+62:11602:x1869199342399616:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782607704.152548:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607704.152572:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467000/0x8109266df35cc036 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b5862a00022 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607704.152610:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466800/0x8109266df35cc03d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607704.152626:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466800/0x8109266df35cc03d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607704.152637:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466800/0x8109266df35cc03d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607704.152743:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467000/0x8109266df35cc036 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00022 expref: 64 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607704.152760:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466800/0x8109266df35cc03d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00022 expref: 63 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607704.152806:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff974543e77700) 00010000:00010000:1.0:1782607704.152808:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782607704.152812:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97457f466800, rc 0) 00000100:00100000:1.0:1782607704.152872:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745675f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+63:11602:x1869199342399616:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 Request processed in 359us (1106us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607704.152902:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 221 00000100:00100000:2.0:1782607704.157549:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607704.169474:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342399872 00000100:00100000:0.0:1782607704.169495:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342399872 00000100:00100000:0.0:1782607704.169594:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 222 00000100:00100000:0.0:1782607704.169606:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+63:11602:x1869199342399872:12345-192.168.202.4@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1782607704.169708:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cc044 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.169728:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cc044 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.169746:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cc044 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782607704.170510:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00010000:0.0:1782607704.170608:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003ff61919 reply state 00000000bcff6236 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cc044 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607704.170619:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782607704.170744:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+65:11602:x1869199342399872:12345-192.168.202.4@tcp:36:lhsmtool_posix.0 Request processed in 1138us (13201us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1782607704.170753:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 222 00010000:00010000:1.0:1782607704.177659:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cc044 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607704.177679:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cc044 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607704.177706:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cc044 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607704.177712:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42c00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607704.177717:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cc044 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607704.177722:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:1.0:1782607704.177725:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cc044 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607704.177744:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff974543e77700) 00010000:00010000:1.0:1782607704.177747:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782607704.177753:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cc044 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607704.177759:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cc044 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607704.178019:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342400000 00000100:00100000:3.0:1782607704.178037:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342400000 00000100:00100000:3.0:1782607704.178168:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 223 00000100:00100000:3.0:1782607704.178179:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443763480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+64:11602:x1869199342400000:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782607704.178203:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607704.178220:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649800/0x8109266df35cc04b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b5862a00029 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.178355:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649800/0x8109266df35cc04b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00029 expref: 65 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.178370:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649800/0x8109266df35cc04b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00029 expref: 65 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.178389:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff974543e77700) 00010000:00010000:3.0:1782607704.178392:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782607704.178394:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97455d649800, rc 0) 00000100:00100000:3.0:1782607704.178468:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443763480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+65:11602:x1869199342400000:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 Request processed in 291us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607704.178476:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 223 00000100:00100000:2.0:1782607704.185318:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607704.185471:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342400128 00000100:00100000:0.0:1782607704.185482:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342400128 00000100:00100000:0.0:1782607704.185556:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 63 00000100:00100000:0.0:1782607704.185566:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443763800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+9:2356:x1869199342400128:12345-192.168.202.4@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1782607704.185890:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443763800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+10:2356:x1869199342400128:12345-192.168.202.4@tcp:2:lhsmtool_posix.0 Request processed in 315us (572us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1782607704.185908:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 63 00000100:00080000:1.0:1782607704.186086:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782607704.192712:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607704.193005:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342400384 00000100:00100000:1.0:1782607704.193017:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342400384 00000100:00100000:1.0:1782607704.193153:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 60 00000100:00100000:1.0:1782607704.193165:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443760e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+65:11602:x1869199342400384:12345-192.168.202.4@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1782607704.193590:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443760e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+66:11602:x1869199342400384:12345-192.168.202.4@tcp:35:lhsmtool_posix.0 Request processed in 426us (889us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1782607704.193600:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 60 00000100:00100000:2.0:1782607704.200489:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607704.201168:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342400640 00000100:00100000:3.0:1782607704.201180:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342400640 00000100:00100000:0.0:1782607704.201340:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 224 00000100:00100000:0.0:1782607704.201354:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443760700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+66:11602:x1869199342400640:12345-192.168.202.4@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1782607704.201518:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443760700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+66:11602:x1869199342400640:12345-192.168.202.4@tcp:57:lhsmtool_posix.0 Request processed in 168us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607704.201526:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 224 00000100:00100000:2.0:1782607704.207295:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607704.207391:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342400768 00000100:00100000:3.0:1782607704.207401:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342400768 00000100:00100000:3.0:1782607704.207465:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 225 00000100:00100000:3.0:1782607704.207476:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443762680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+66:11602:x1869199342400768:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782607704.207498:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607704.207520:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cc052 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b5862a00030 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.207620:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cc059 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.207634:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cc059 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.207645:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cc059 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782607704.207683:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782607704.207702:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cc059 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.207733:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cc052 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00030 expref: 68 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.207753:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cc059 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00030 expref: 67 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.209016:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff974543e77700) 00010000:00010000:3.0:1782607704.209025:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1782607704.209030:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97455d649a00, rc 0) 00000100:00100000:2.0:1782607704.211674:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443762680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+67:11602:x1869199342400768:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 Request processed in 4178us (4371us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607704.211687:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 225 00000100:00100000:2.0:1782607704.220852:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607704.223300:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342400896 00000100:00100000:0.0:1782607704.223316:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342400896 00000100:00100000:0.0:1782607704.223542:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 64 00000100:00100000:0.0:1782607704.223556:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443760380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+10:2357:x1869199342400896:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782607704.223576:0:6608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607704.223601:0:6608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb7c2079/0x8109266df35cc060 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b5862a00037 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782607704.223629:0:6608:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a406f59, blocks: 0x1 00010000:00010000:0.0:1782607704.223651:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=363s v=(0 0) 00010000:00010000:0.0:1782607704.223656:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607704.223666:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb7c2079/0x8109266df35cc060 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00037 expref: 11 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.223686:0:6608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cb7c2079/0x8109266df35cc060 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00037 expref: 11 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.223699:0:6608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c42a00, rc 0) 00000100:00100000:0.0:1782607704.223813:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443760380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+11:2357:x1869199342400896:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 Request processed in 260us (2973us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607704.223821:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 64 00000100:00100000:0.0:1782607704.230093:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607704.230207:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342401152 00000100:00100000:2.0:1782607704.230220:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342401152 00000100:00100000:2.0:1782607704.230298:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 226 00000100:00100000:2.0:1782607704.230309:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+67:11602:x1869199342401152:12345-192.168.202.4@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1782607704.230437:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+67:11602:x1869199342401152:12345-192.168.202.4@tcp:57:lhsmtool_posix.0 Request processed in 129us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607704.230444:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 226 00000100:00100000:2.0:1782607704.235319:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607704.235520:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342401280 00000100:00100000:0.0:1782607704.235530:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342401280 00000100:00100000:0.0:1782607704.235591:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 65 00000100:00100000:0.0:1782607704.235602:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443760a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+11:11602:x1869199342401280:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782607704.235621:0:6610:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607704.235640:0:6610:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb4c435d/0x8109266df35cc067 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b5862a0003e expref: -99 pid: 6610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.235674:0:6610:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb7c2079/0x8109266df35cc060 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00037 expref: 12 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.235684:0:6610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607704.235688:0:6610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607704.235694:0:6610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb4c435d/0x8109266df35cc067 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0003e expref: 12 pid: 6610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.235736:0:6610:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cb7c2079/0x8109266df35cc060 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00037 expref: 12 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.235750:0:6610:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cb7c2079/0x8109266df35cc060 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00037 expref: 12 pid: 6608 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607704.235822:0:6610:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f4b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6610:1869199364407296:192.168.202.4@tcp:104: 00000100:00100000:0.0:1782607704.235920:0:6610:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745509bfe40 going to sleep for 11 seconds 00000100:00100000:0.0:1782607704.239293:0:6610:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f4b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6610:1869199364407296:192.168.202.4@tcp:104: 00010000:00010000:0.0:1782607704.239330:0:6610:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eb4c435d/0x8109266df35cc067 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0003e expref: 12 pid: 6610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.239385:0:6610:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c42600, rc 0) 00000100:00100000:0.0:1782607704.239451:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443760a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+12:11602:x1869199342401280:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 Request processed in 3850us (4142us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607704.239460:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 65 00000100:00100000:1.0:1782607704.264601:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607704.264909:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342401408 00000100:00100000:2.0:1782607704.264919:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342401408 00010000:00010000:2.0:1782607704.264967:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cb7c2079/0x8109266df35cc060 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00037 expref: 12 pid: 6608 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607704.265011:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 79 00000100:00100000:2.0:1782607704.265021:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+12:2356:x1869199342401408:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782607704.265066:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782607704.265089:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cb7c2079/0x8109266df35cc060 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00037 expref: 12 pid: 6608 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.265104:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cb7c2079/0x8109266df35cc060 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00037 expref: 12 pid: 6608 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.265127:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb7c2079/0x8109266df35cc060 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00037 expref: 12 pid: 6608 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.265144:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782607704.265149:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782607704.265159:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb4c435d/0x8109266df35cc067 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0003e expref: 11 pid: 6610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.265168:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb4c435d/0x8109266df35cc067 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0003e expref: 11 pid: 6610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.265208:0:5787:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000eb4c435d/0x8109266df35cc067 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0003e expref: 11 pid: 6610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607704.265225:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581539c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5787:1869199364407424:192.168.202.4@tcp:105: 00000100:00100000:2.0:1782607704.265332:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff97457f49e180 going to sleep for 11 seconds 00000100:00100000:0.0:1782607704.270714:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581539c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5787:1869199364407424:192.168.202.4@tcp:105: 00010000:00010000:0.0:1782607704.270740:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782607704.270851:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+11:2356:x1869199342401408:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 5829us (6259us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607704.270863:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 79 00000100:00100000:1.0:1782607704.273758:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607704.274036:0:6614:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342401536 00000100:00100000:2.0:1782607704.274047:0:6614:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342401536 00002000:00100000:2.0:1782607704.274096:0:6614:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff97457f4bbb80 x1869199342401536/t0(0) o4->d72d7fb9-639f-4ad9-b658-df715cbf7792@192.168.202.4@tcp:620/0 lens 504/0 e 0 to 0 dl 1782607715 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782607704.274115:0:6614:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97457f4bbb80 with x1869199342401536 ext(0->12) 00002000:00010000:2.0:1782607704.274121:0:6614:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97457f4bbb80 00000100:00100000:2.0:1782607704.274156:0:6614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7 00000100:00100000:2.0:1782607704.274167:0:6614:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+11:2357:x1869199342401536:12345-192.168.202.4@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1782607704.274630:0:6614:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+13:2357:x1869199342401536:12345-192.168.202.4@tcp:4:lhsmtool_posix.0 Request processed in 463us (880us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1782607704.274639:0:6614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7 00002000:00100000:2.0:1782607704.274646:0:6614:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff97457f4bbb80 x1869199342401536/t4294967320(0) o4->d72d7fb9-639f-4ad9-b658-df715cbf7792@192.168.202.4@tcp:620/0 lens 504/448 e 0 to 0 dl 1782607715 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782607704.274666:0:6614:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97457f4bbb80 with x1869199342401536 ext(0->12) 00002000:00010000:2.0:1782607704.274669:0:6614:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97457f4bbb80 00000100:00100000:3.0:1782607704.282871:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607704.283388:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342401664 00000100:00100000:2.0:1782607704.283408:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342401664 00000100:00100000:2.0:1782607704.283476:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 227 00000100:00100000:2.0:1782607704.283487:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f46dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+67:11602:x1869199342401664:12345-192.168.202.4@tcp:44:lhsmtool_posix.0 00010000:00010000:2.0:1782607704.322152:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782607704.346346:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:3.0:1782607704.346364:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:3.0:1782607704.346466:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000001:00080000:3.0:1782607704.346490:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:3.0:1782607704.346522:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:3.0:1782607704.346617:0:5825:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97457f49e480 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1782607704.346638:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff97457f837e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97457f49e0c0 00000020:00080000:3.0:1782607704.346642:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff97457f837400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97457774b800 00000020:00080000:3.0:1782607704.346692:0:5825:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff974442a7cd80 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1782607704.346695:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9745676ec200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff974442a7cf00 00000020:00080000:3.0:1782607704.346697:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9745676ec100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff974549c45000 00000100:00100000:3.0:1782607704.347029:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f46ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364407552:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782607704.347164:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607704.347317:0:9088:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364407552 00000100:00100000:3.0:1782607704.347325:0:9088:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364407552 00000100:00100000:3.0:1782607704.347661:0:9088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1782607704.347672:0:9088:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f46d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3317:x1869199364407552:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1782607704.347699:0:9088:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:3.0:1782607704.347733:0:9088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a406f57, atime: 0x6a406f57, ctime: 0x6a406f57, blocks: 0x1 00010000:00010000:3.0:1782607704.347742:0:9088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006274f0e7/0x8109266df35cc06e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.347759:0:9088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=363s v=(0 0) 00000100:00100000:1.0:1782607704.347983:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f46dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+21:11602:x1869199342401664:12345-192.168.202.4@tcp:44:lhsmtool_posix.0 Request processed in 64495us (65122us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607704.347992:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 227 00010000:00010000:3.0:1782607704.351956:0:9088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782607704.351978:0:9088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006274f0e7/0x8109266df35cc06e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.352005:0:9088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006274f0e7/0x8109266df35cc06e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.352018:0:9088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006274f0e7/0x8109266df35cc06e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.352042:0:9088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006274f0e7/0x8109266df35cc06e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.352082:0:9088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782607704.353428:0:9088:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f46d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3317:x1869199364407552:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5382us (5888us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1782607704.353442:0:9088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1782607704.353507:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f4b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364407680:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1782607704.353684:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97457f46ea00/2, rc 0, transno 4294967310 00000100:00100000:1.0:1782607704.353692:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f46ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364407552:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782607704.353890:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1782607704.354076:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1782607704.354218:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:0.0:1782607704.354385:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782607704.354394:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006274f0e7/0x8109266df35cc06e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.354407:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d649400 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:0.0:1782607704.354411:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006274f0e7/0x8109266df35cc06e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.354422:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006274f0e7/0x8109266df35cc06e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.354441:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006274f0e7/0x8109266df35cc06e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.354448:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006274f0e7/0x8109266df35cc06e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.354486:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607704.354488:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607704.354490:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607704.355458:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364407680 00000100:00100000:1.0:1782607704.355470:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364407680 00000100:00100000:1.0:1782607704.355628:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1782607704.355639:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f46c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3318:x1869199364407680:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782607704.355676:0:6609:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:1.0:1782607704.355706:0:6609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2c31efd/0x8109266df35cc075 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607704.355729:0:6609:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe97f639/0x8109266df35cbe30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff9d expref: 12 pid: 6610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607704.355738:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1782607704.355742:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782607704.355747:0:6609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2c31efd/0x8109266df35cc075 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607704.355814:0:6609:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fe97f639/0x8109266df35cbe30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff9d expref: 12 pid: 6610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607704.355829:0:6609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fe97f639/0x8109266df35cbe30 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff9d expref: 12 pid: 6610 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607704.355864:0:6609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f4b9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6609:1869199364407808:192.168.202.4@tcp:104: 00000100:00100000:1.0:1782607704.356082:0:6609:0:(client.c:2701:ptlrpc_set_wait()) set ffff974550578180 going to sleep for 11 seconds 00000100:00100000:3.0:1782607704.357865:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607704.361430:0:6609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f4b9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6609:1869199364407808:192.168.202.4@tcp:104: 00010000:00010000:3.0:1782607704.361462:0:6609:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d2c31efd/0x8109266df35cc075 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607704.363199:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607704.363234:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342401920 00000100:00100000:2.0:1782607704.363253:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342401920 00010000:00010000:2.0:1782607704.363295:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fe97f639/0x8109266df35cbe30 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff9d expref: 13 pid: 6610 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607704.363362:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 80 00000100:00100000:2.0:1782607704.363381:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455109ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+13:2357:x1869199342401920:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782607704.363398:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782607704.363404:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fe97f639/0x8109266df35cbe30 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff9d expref: 13 pid: 6610 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.363418:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fe97f639/0x8109266df35cbe30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff9d expref: 13 pid: 6610 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.363441:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe97f639/0x8109266df35cbe30 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff9d expref: 13 pid: 6610 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.363460:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782607704.363465:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782607704.363470:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d2c31efd/0x8109266df35cc075 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.363481:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2c31efd/0x8109266df35cc075 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.363507:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782607704.364200:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455109ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+12:2357:x1869199342401920:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 825us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607704.364209:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 80 00010000:00010000:2.0:1782607704.364297:0:6609:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d2c31efd/0x8109266df35cc075 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.364309:0:6609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2c31efd/0x8109266df35cc075 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.364319:0:6609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2c31efd/0x8109266df35cc075 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.364326:0:6609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2c31efd/0x8109266df35cc075 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.364474:0:6609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782607704.366026:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f46c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3318:x1869199364407680:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10382us (12130us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1782607704.366039:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:3.0:1782607704.366133:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97457f4b4000/2, rc 0, transno 4294967321 00000100:00100000:3.0:1782607704.366149:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f4b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364407680:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782607704.366230:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342401792 00000100:00100000:0.0:1782607704.366247:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342401792 00000100:00100000:0.0:1782607704.367719:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 68 00000100:00100000:0.0:1782607704.367732:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f46f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+12:2357:x1869199342401792:12345-192.168.202.4@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1782607704.368267:0:7513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782607704.368278:0:7513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2c31efd/0x8109266df35cc075 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.368291:0:7513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f467800 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:2.0:1782607704.368295:0:7513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2c31efd/0x8109266df35cc075 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.368306:0:7513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2c31efd/0x8109266df35cc075 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.368347:0:7513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2c31efd/0x8109266df35cc075 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.368355:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2c31efd/0x8109266df35cc075 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.368396:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607704.368398:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607704.368400:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782607704.407351:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f46f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+12:2357:x1869199342401792:12345-192.168.202.4@tcp:16:lhsmtool_posix.0 Request processed in 39598us (49473us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607704.407376:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 68 00000001:00080000:2.0:1782607704.412063:0:6634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000001:00080000:2.0:1782607704.412089:0:6634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:2.0:1782607704.412099:0:6634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:2.0:1782607704.412105:0:6634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:1.0:1782607704.412702:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607704.413041:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342402176 00000100:00100000:2.0:1782607704.413051:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342402176 00000100:00100000:2.0:1782607704.413129:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 228 00000100:00100000:2.0:1782607704.413141:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+21:11602:x1869199342402176:12345-192.168.202.4@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1782607704.413203:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782607704.413232:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cc059 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00030 expref: 21 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.413260:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff974543e77700) 00010000:00010000:2.0:1782607704.413280:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782607704.413320:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548400/0x8109266df35cc07c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.413347:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974541548400/0x8109266df35cc07c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.413360:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541548400/0x8109266df35cc07c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782607704.414226:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000df247fea reply state 00000000de7d7a56 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff974541548400/0x8109266df35cc07c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607704.414246:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782607704.415857:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+22:11602:x1869199342402176:12345-192.168.202.4@tcp:36:lhsmtool_posix.0 Request processed in 1395us (1838us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1782607704.416056:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 228 00010000:00010000:1.0:1782607704.419490:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548400/0x8109266df35cc07c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607704.419506:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974541548400/0x8109266df35cc07c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607704.419513:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974541548400/0x8109266df35cc07c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607704.419520:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974541548400 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607704.419525:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541548400/0x8109266df35cc07c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607704.419613:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541548400/0x8109266df35cc07c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607704.419634:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff974543e77700) 00010000:00010000:1.0:1782607704.419638:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607704.419642:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974541548400/0x8109266df35cc07c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607704.419648:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541548400/0x8109266df35cc07c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607704.421337:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607704.422164:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342402304 00000100:00100000:3.0:1782607704.422175:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342402304 00000100:00100000:3.0:1782607704.422271:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 69 00000100:00100000:3.0:1782607704.422282:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:2356:x1869199342402304:12345-192.168.202.4@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1782607704.422688:0:6608:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1782607704.422692:0:6608:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1782607704 00002000:00010000:3.0:1782607704.422695:0:6608:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1782607703 00002000:00010000:3.0:1782607704.422696:0:6608:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1782607705 -> 1782607704 00002000:00010000:3.0:1782607704.422712:0:6608:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1782607704.422822:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+8:2356:x1869199342402304:12345-192.168.202.4@tcp:2:lhsmtool_posix.0 Request processed in 541us (1497us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1782607704.422831:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 69 00000100:00100000:0.0:1782607704.429073:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607704.429157:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342402560 00000100:00100000:2.0:1782607704.429167:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342402560 00000100:00100000:2.0:1782607704.429234:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 229 00000100:00100000:2.0:1782607704.429313:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+21:11602:x1869199342402560:12345-192.168.202.4@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1782607704.429398:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cc083 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.429419:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466800/0x8109266df35cc03d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00022 expref: 21 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.429430:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cc083 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.429469:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466800/0x8109266df35cc03d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00022 expref: 21 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.429502:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466800/0x8109266df35cc03d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00022 expref: 21 pid: 5803 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607704.429519:0:5805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97458153aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1869199364407936:192.168.202.4@tcp:104: 00000100:00100000:2.0:1782607704.429623:0:5805:0:(client.c:2701:ptlrpc_set_wait()) set ffff97457f49e180 going to sleep for 11 seconds 00000100:00100000:2.0:1782607704.433212:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607704.433368:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342402688 00000100:00100000:3.0:1782607704.433380:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342402688 00010000:00010000:3.0:1782607704.433428:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466800/0x8109266df35cc03d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00022 expref: 22 pid: 5803 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607704.433467:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 81 00000100:00100000:3.0:1782607704.433477:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581539c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+22:2357:x1869199342402688:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782607704.433493:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782607704.433499:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466800/0x8109266df35cc03d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00022 expref: 22 pid: 5803 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.433511:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466800/0x8109266df35cc03d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00022 expref: 22 pid: 5803 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.433544:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff974543e77700) 00010000:00010000:3.0:1782607704.433550:0:5787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cc083 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.433558:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cc083 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.433566:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cc083 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.433585:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782607704.433654:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581539c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+22:2357:x1869199342402688:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 178us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607704.433662:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 81 00010000:00010000:0.0:1782607704.436027:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466800/0x8109266df35cc03d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00022 expref: 21 pid: 5803 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607704.436060:0:5805:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97458153aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5805:1869199364407936:192.168.202.4@tcp:104: 00010000:00010000:0.0:1782607704.436089:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cc083 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.436100:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cc083 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.436106:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cc083 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.436147:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cc083 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.436155:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cc083 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.436163:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cc083 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.436188:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974541548a00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607704.436193:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cc083 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.436200:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cc083 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.436219:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff974543e77700) 00010000:00010000:0.0:1782607704.436222:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1782607704.436227:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cc083 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.436233:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cc083 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607704.437692:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+20:11602:x1869199342402560:12345-192.168.202.4@tcp:55:lhsmtool_posix.0 Request processed in 8372us (8616us total) trans 0 rc -22/-22 00000100:00100000:0.0:1782607704.437707:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 229 00000100:00100000:2.0:1782607704.447612:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607704.447717:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342402816 00000100:00100000:3.0:1782607704.447728:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342402816 00000100:00100000:3.0:1782607704.447835:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 70 00000100:00100000:3.0:1782607704.447845:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458153aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+8:2355:x1869199342402816:12345-192.168.202.4@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1782607704.447900:0:6609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cc9d7b36/0x8109266df35cc08a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.447921:0:6609:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb4c435d/0x8109266df35cc067 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0003e expref: 8 pid: 6610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.447930:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782607704.447934:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782607704.447940:0:6609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc9d7b36/0x8109266df35cc08a lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.447975:0:6609:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eb4c435d/0x8109266df35cc067 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0003e expref: 8 pid: 6610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.447989:0:6609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eb4c435d/0x8109266df35cc067 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0003e expref: 8 pid: 6610 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607704.448002:0:6609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d461180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6609:1869199364408064:192.168.202.4@tcp:104: 00000100:00100000:3.0:1782607704.448083:0:6609:0:(client.c:2701:ptlrpc_set_wait()) set ffff974442a7c180 going to sleep for 11 seconds 00000100:00100000:3.0:1782607704.453549:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607704.453757:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342402944 00000100:00100000:0.0:1782607704.453814:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342402944 00010000:00010000:0.0:1782607704.453862:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eb4c435d/0x8109266df35cc067 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0003e expref: 9 pid: 6610 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607704.453912:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 82 00000100:00100000:0.0:1782607704.453923:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455d461500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+9:2357:x1869199342402944:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782607704.453940:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782607704.453967:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eb4c435d/0x8109266df35cc067 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0003e expref: 9 pid: 6610 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.453993:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eb4c435d/0x8109266df35cc067 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0003e expref: 9 pid: 6610 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.454022:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782607704.454027:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782607704.454033:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc9d7b36/0x8109266df35cc08a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.454045:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc9d7b36/0x8109266df35cc08a lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.454067:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782607704.454120:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455d461500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+9:2357:x1869199342402944:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 198us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607704.454129:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 82 00010000:00010000:2.0:1782607704.454837:0:6609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb4c435d/0x8109266df35cc067 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0003e expref: 8 pid: 6610 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607704.454855:0:6609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d461180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6609:1869199364408064:192.168.202.4@tcp:104: 00010000:00010000:2.0:1782607704.454882:0:6609:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cc9d7b36/0x8109266df35cc08a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.454902:0:6609:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cc9d7b36/0x8109266df35cc08a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.454910:0:6609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc9d7b36/0x8109266df35cc08a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.454939:0:6609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cc9d7b36/0x8109266df35cc08a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.454948:0:6609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc9d7b36/0x8109266df35cc08a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.454968:0:6609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc9d7b36/0x8109266df35cc08a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.454976:0:6609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d649200 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:2.0:1782607704.454980:0:6609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc9d7b36/0x8109266df35cc08a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.454991:0:6609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc9d7b36/0x8109266df35cc08a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.455004:0:6609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc9d7b36/0x8109266df35cc08a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.455013:0:6609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc9d7b36/0x8109266df35cc08a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607704.455067:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458153aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:2355:x1869199342402816:12345-192.168.202.4@tcp:1:lhsmtool_posix.0 Request processed in 7224us (7469us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607704.455076:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 70 00000100:00100000:1.0:1782607704.459188:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607704.459548:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342403200 00000100:00100000:2.0:1782607704.459559:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342403200 00000100:00100000:2.0:1782607704.459624:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 230 00000100:00100000:2.0:1782607704.459634:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+20:11602:x1869199342403200:12345-192.168.202.4@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1782607704.459718:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cc091 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.459744:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cc091 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.459757:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cc091 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.460175:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cc098 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.460187:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649800/0x8109266df35cc04b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00029 expref: 21 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.460197:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cc098 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.460233:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649800/0x8109266df35cc04b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00029 expref: 21 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.460248:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649800/0x8109266df35cc04b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00029 expref: 21 pid: 5805 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607704.460264:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974443761880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5804:1869199364408192:192.168.202.4@tcp:104: 00000100:00100000:2.0:1782607704.460349:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff97457f49e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782607704.464931:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974443761880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5804:1869199364408192:192.168.202.4@tcp:104: 00010000:00010000:2.0:1782607704.464964:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cc098 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607704.468309:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607704.468842:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342403328 00000100:00100000:2.0:1782607704.468874:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342403328 00010000:00010000:2.0:1782607704.468932:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649800/0x8109266df35cc04b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00029 expref: 22 pid: 5805 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607704.468977:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 83 00000100:00100000:2.0:1782607704.468987:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+22:2357:x1869199342403328:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782607704.469004:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782607704.469011:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649800/0x8109266df35cc04b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00029 expref: 22 pid: 5805 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.469025:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649800/0x8109266df35cc04b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00029 expref: 22 pid: 5805 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.469047:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649800/0x8109266df35cc04b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00029 expref: 22 pid: 5805 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.469065:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff974543e77700) 00010000:00010000:2.0:1782607704.469071:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cc098 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.469080:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cc098 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.469088:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cc098 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.469118:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782607704.469178:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+21:2357:x1869199342403328:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 191us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607704.469195:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 83 00010000:00010000:3.0:1782607704.470607:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cc098 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.470622:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cc098 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782607704.470905:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1782607704.471083:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1782607704.471131:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1782607704.471232:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d461180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5804:1869199364408320:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1782607704.471317:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607704.471356:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff974442a7c300 going to sleep for 11 seconds 00000100:00100000:0.0:1782607704.471697:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364408320 00000100:00100000:0.0:1782607704.471707:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364408320 00000100:00100000:0.0:1782607704.471761:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782607704.471806:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5804:x1869199364408320:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1782607704.471879:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5804:x1869199364408320:12345-0@lo:1000:mdt00_001.0 Request processed in 76us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607704.471887:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782607704.472963:0:5804:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:3.0:1782607704.472973:0:5804:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:3.0:1782607704.472998:0:5804:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97457f4b4000, transno 4294967321 00000100:00100000:3.0:1782607704.473013:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d461180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5804:1869199364408320:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1782607704.479696:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1782607704.480501:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f4b4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5804:1869199364408448:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1782607704.480600:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607704.480694:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff974551338c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782607704.483169:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364408448 00000100:00100000:3.0:1782607704.483184:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364408448 00000100:00100000:3.0:1782607704.483248:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782607704.483257:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5804:x1869199364408448:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1782607704.483718:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5804:x1869199364408448:12345-0@lo:1000:mdt00_001.0 Request processed in 460us (3117us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1782607704.483726:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782607704.486416:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f4b4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5804:1869199364408448:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1782607704.486502:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cc098 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.486515:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cc098 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.486522:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cc098 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.486528:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974541548e00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607704.486533:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cc098 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.486540:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cc098 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.486557:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff974543e77700) 00010000:00010000:2.0:1782607704.486560:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782607704.486566:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cc098 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.486573:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541548e00/0x8109266df35cc098 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.486615:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cbfdb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.486622:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cbfdb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.486650:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cbfdb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.486655:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f467600 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607704.486658:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cbfdb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.486665:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cbfdb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.486673:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97454be19300) 00010000:00010000:2.0:1782607704.486676:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782607704.486683:0:5804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbfe2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0000d expref: 24 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.486694:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbfe2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0000d expref: 24 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.486703:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbfe2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0000d expref: 24 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607704.486747:0:5804:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbfe2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0000d expref: 24 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607704.486795:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974443761880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5804:1869199364408576:192.168.202.4@tcp:105: 00000100:00100000:2.0:1782607704.486910:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff97457f49e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782607704.495002:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607704.495285:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974443761880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5804:1869199364408576:192.168.202.4@tcp:105: 00010000:00010000:0.0:1782607704.495319:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cbfdb lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.495331:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cbfdb lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.495367:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cc09f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.495383:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cc09f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.495396:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cc09f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.495408:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cc09f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.495414:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cc09f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.495422:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cc09f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.495428:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c43400 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607704.495432:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cc09f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.495440:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cc09f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.495468:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97454be19300) 00010000:00010000:0.0:1782607704.495471:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782607704.495474:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cc09f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.495479:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cc09f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.495490:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cc091 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.495494:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cc091 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.495500:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cc091 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.495505:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974541548a00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607704.495508:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cc091 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.495515:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cc091 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.495523:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97454be19300) 00010000:00010000:0.0:1782607704.495525:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782607704.495528:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cc091 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.495534:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541548a00/0x8109266df35cc091 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607704.495853:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+24:11602:x1869199342403200:12345-192.168.202.4@tcp:57:lhsmtool_posix.0 Request processed in 36218us (36675us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1782607704.495864:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 230 00000020:00080000:0.0:1782607704.495871:0:5804:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1782607704.496164:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342403456 00000100:00100000:3.0:1782607704.496172:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342403456 00000100:00100000:3.0:1782607704.496223:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 61 00000100:00100000:3.0:1782607704.496232:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745675f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+24:11601:x1869199342403456:12345-192.168.202.4@tcp:49:lfs.0 00000100:00100000:3.0:1782607704.496325:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745675f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+24:11601:x1869199342403456:12345-192.168.202.4@tcp:49:lfs.0 Request processed in 94us (1336us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607704.496339:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 61 00000040:00080000:2.0:1782607704.496462:0:11563:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782607704.496473:0:11563:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782607704.499484:0:11563:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1782607704.499505:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782607704.508464:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607704.509678:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342403712 00000100:00100000:2.0:1782607704.509694:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342403712 00000100:00100000:2.0:1782607704.509836:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 231 00000100:00100000:2.0:1782607704.509851:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+24:11601:x1869199342403712:12345-192.168.202.4@tcp:58:lfs.0 00000100:00100000:3.0:1782607704.510026:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000040:00080000:2.0:1782607704.510358:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1782607704.510463:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+24:11601:x1869199342403712:12345-192.168.202.4@tcp:58:lfs.0 Request processed in 615us (2011us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607704.510472:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 231 00000100:00100000:1.0:1782607704.510568:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342403968 00000100:00100000:1.0:1782607704.510574:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342403968 00000100:00100000:1.0:1782607704.510617:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 62 00000100:00100000:1.0:1782607704.510625:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549b8a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+24:11602:x1869199342403968:12345-192.168.202.4@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1782607704.511244:0:5806:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1782607704.511354:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:1.0:1782607704.511400:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cc0a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607704.511419:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cc0a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607704.511430:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cc0a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607704.511439:0:5806:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cc0a6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607704.511446:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cc0a6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607704.511452:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cc0a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607704.511481:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782607704.511555:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549b8a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+26:11602:x1869199342403968:12345-192.168.202.4@tcp:35:lhsmtool_posix.0 Request processed in 930us (1528us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1782607704.511564:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 62 00000020:00080000:1.0:1782607704.511575:0:5806:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782607704.511984:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782607704.511991:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cc0a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.511998:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f467200 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:3.0:1782607704.512002:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cc0a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.512009:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cc0a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.512022:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff974543e77500) 00010000:00010000:3.0:1782607704.512025:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782607704.512029:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cc0a6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.512035:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467200/0x8109266df35cc0a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.512062:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607704.512064:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607704.512066:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782607704.554851:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607704.554938:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342404096 00000100:00100000:0.0:1782607704.554950:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342404096 00000100:00100000:0.0:1782607704.555019:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 232 00000100:00100000:0.0:1782607704.555031:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455d461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+26:11604:x1869199342404096:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1782607704.555056:0:7437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607704.555078:0:7437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cc0ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b5862a00045 expref: -99 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.555159:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cc0b4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.555176:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cc0b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.555187:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cc0b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.555224:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cc0bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.555232:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cc0bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.555250:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cc0bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.555559:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cc0c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.555571:0:7437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbfcd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00006 expref: 27 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.555578:0:7437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cc0c2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.555610:0:7437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbfcd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00006 expref: 27 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.555624:0:7437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbfcd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00006 expref: 27 pid: 7437 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607704.555637:0:7437:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974443761c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7437:1869199364408704:192.168.202.4@tcp:104: 00000100:00100000:0.0:1782607704.555724:0:7437:0:(client.c:2701:ptlrpc_set_wait()) set ffff974543d793c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782607704.561000:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607704.561093:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342404352 00000100:00100000:2.0:1782607704.561104:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342404352 00000100:00100000:2.0:1782607704.561167:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 63 00000100:00100000:2.0:1782607704.561179:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+28:5568:x1869199342404352:12345-192.168.202.4@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1782607704.561449:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+29:5568:x1869199342404352:12345-192.168.202.4@tcp:35:ldlm_bl.0 Request processed in 271us (459us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1782607704.561456:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 63 00000100:00100000:0.0:1782607704.562436:0:7437:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974443761c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7437:1869199364408704:192.168.202.4@tcp:104: 00010000:00010000:0.0:1782607704.562468:0:7437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cc0c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607704.568467:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607704.568677:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342404480 00000100:00100000:0.0:1782607704.568687:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342404480 00010000:00010000:0.0:1782607704.568728:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbfcd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00006 expref: 29 pid: 7437 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607704.568905:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 84 00000100:00100000:0.0:1782607704.568915:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745776b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+29:2356:x1869199342404480:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782607704.568945:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782607704.568952:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbfcd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00006 expref: 29 pid: 7437 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.568965:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbfcd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00006 expref: 29 pid: 7437 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.568986:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42000/0x8109266df35cbfcd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00006 expref: 29 pid: 7437 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.569002:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97454be19300) 00010000:00010000:0.0:1782607704.569007:0:5787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cc0c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.569017:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cc0c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.569023:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cc0c2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607704.569101:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782607704.569168:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745776b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+28:2356:x1869199342404480:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 253us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607704.569176:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 84 00010000:00010000:3.0:1782607704.574525:0:7437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cc0c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.574545:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cc0c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782607704.574617:0:7437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1782607704.574622:0:7437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782607704.574645:0:7437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cc0c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.574661:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cc0c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.574673:0:7437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cc0b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.574680:0:7437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cc0b4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.574688:0:7437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cc0b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.574695:0:7437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42600 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:3.0:1782607704.574700:0:7437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cc0b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.574709:0:7437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cc0b4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.574730:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97454be19200) 00010000:00010000:3.0:1782607704.574734:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782607704.574739:0:7437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cc0b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.574745:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cc0b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.574789:0:7437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cc0bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.574796:0:7437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cc0bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.574802:0:7437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cc0bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.574807:0:7437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42200 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:3.0:1782607704.574810:0:7437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cc0bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.574817:0:7437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cc0bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.574826:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97454be19c00) 00010000:00010000:3.0:1782607704.574829:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782607704.574832:0:7437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cc0bb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.574837:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cc0bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.575026:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cc0ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00045 expref: 28 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.575045:0:7437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cc0c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00045 expref: 27 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607704.575064:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97454be19300) 00010000:00010000:3.0:1782607704.575066:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782607704.575069:0:7437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c42c00, rc 0) 00000100:00100000:3.0:1782607704.575144:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455d461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+27:11604:x1869199342404096:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 20114us (20301us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607704.575154:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 232 00010000:00010000:0.0:1782607705.346434:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782607705.539114:0:11563:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782607705.539126:0:11563:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782607705.539165:0:11563:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1782607705.539173:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782607705.539312:0:11563:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745675f6a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11563:1869199364408832:192.168.202.4@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1782607705.539529:0:11563:0:(client.c:2701:ptlrpc_set_wait()) set ffff97457f49e180 going to sleep for 11 seconds 00000100:00100000:2.0:1782607705.546261:0:11563:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745675f6a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11563:1869199364408832:192.168.202.4@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1782607705.549947:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607705.550641:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342404608 00000100:00100000:0.0:1782607705.550653:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342404608 00000100:00100000:0.0:1782607705.550718:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 233 00000100:00100000:0.0:1782607705.550728:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+27:11615:x1869199342404608:12345-192.168.202.4@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782607705.550820:0:5803:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782607705.550942:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+27:11615:x1869199342404608:12345-192.168.202.4@tcp:53:lhsmtool_posix.0 Request processed in 214us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607705.550949:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 233 00000100:00080000:1.0:1782607705.551670:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782607705.566548:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607705.566654:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342404864 00000100:00100000:0.0:1782607705.566665:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342404864 00000100:00100000:0.0:1782607705.566730:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 234 00000100:00100000:0.0:1782607705.566740:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745776b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+27:11615:x1869199342404864:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782607705.566761:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607705.566804:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cc0c9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b5862a0004c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607705.566915:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cc0d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607705.566931:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cc0d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607705.566944:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cc0d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782607705.566955:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1782607705.567094:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42200/0x8109266df35cc0c9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0004c expref: 30 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607705.567112:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cc0d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0004c expref: 29 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607705.567137:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97454be19300) 00010000:00010000:0.0:1782607705.567140:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782607705.567143:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c42600, rc 0) 00000100:00100000:0.0:1782607705.567210:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745776b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+29:11615:x1869199342404864:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 Request processed in 462us (662us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1782607705.567217:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 234 00000100:00100000:0.0:1782607705.580392:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607705.580436:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607705.580466:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342405248 00000100:00100000:0.0:1782607705.580474:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342405248 00000100:00100000:0.0:1782607705.580540:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17 00000100:00100000:0.0:1782607705.580551:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443760e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+29:2357:x1869199342405248:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782607705.580568:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782607705.580593:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42600/0x8109266df35cc0d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0004c expref: 29 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607705.580611:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97454be19300) 00010000:00010000:0.0:1782607705.580616:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782607705.580669:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443760e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+28:2357:x1869199342405248:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 121us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607705.580677:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17 00000100:00100000:0.0:1782607705.580778:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342405120 00000100:00100000:0.0:1782607705.580782:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342405120 00000100:00100000:0.0:1782607705.580808:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 235 00000100:00100000:0.0:1782607705.580815:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+28:11615:x1869199342405120:12345-192.168.202.4@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1782607705.580897:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cc0de lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607705.580912:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cc0de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607705.580922:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cc0de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607705.584430:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cc0de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607705.584449:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cc0de lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607705.584457:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cc0de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607705.584463:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c43400 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607705.584468:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cc0de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607705.584476:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cc0de lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607705.584492:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97454be19300) 00010000:00010000:0.0:1782607705.584495:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782607705.584500:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cc0de lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607705.584505:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43400/0x8109266df35cc0de lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607705.584715:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+29:11615:x1869199342405120:12345-192.168.202.4@tcp:57:lhsmtool_posix.0 Request processed in 3895us (4336us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1782607705.584802:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 235 00000040:00080000:3.0:1782607705.585664:0:11563:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782607705.585671:0:11563:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782607705.588632:0:11563:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1782607705.588655:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782607705.595457:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607705.596169:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342405504 00000100:00100000:3.0:1782607705.596181:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342405504 00000100:00100000:3.0:1782607705.596247:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 64 00000100:00100000:3.0:1782607705.596257:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+29:11615:x1869199342405504:12345-192.168.202.4@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1782607705.596492:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+30:11615:x1869199342405504:12345-192.168.202.4@tcp:35:lhsmtool_posix.0 Request processed in 235us (1047us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1782607705.596500:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 64 00000100:00100000:0.0:1782607705.666269:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974541320a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364408960:0@lo:400:kworker.0 00000100:00100000:0.0:1782607705.666580:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607705.666630:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745799a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1869199364409472:0@lo:400:kworker.0 00000100:00100000:0.0:1782607705.666658:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607705.666681:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782607705.666687:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745799a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364409344:0@lo:400:kworker.0 00000100:00100000:0.0:1782607705.666709:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607705.670166:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745799a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1869199364409216:0@lo:400:kworker.0 00000100:00100000:1.0:1782607705.670260:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607705.670311:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782607705.670333:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974541322d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869199364409088:0@lo:400:kworker.0 00000100:00100000:1.0:1782607705.670369:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607705.670389:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974580e53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364409600:0@lo:400:kworker.0 00000100:00100000:1.0:1782607705.670413:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607705.670444:0:9088:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364409344 00000100:00100000:1.0:1782607705.670451:0:9088:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364409344 00000100:00100000:1.0:1782607705.670488:0:9088:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364409600 00000100:00100000:1.0:1782607705.670491:0:9088:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364409600 00000100:00100000:1.0:1782607705.670519:0:9088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1782607705.670527:0:9088:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457fad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3319:x1869199364409344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607705.670579:0:9088:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457fad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3319:x1869199364409344:12345-0@lo:400:kworker.0 Request processed in 52us (3868us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607705.670586:0:9088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1782607705.670601:0:9088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1782607705.670607:0:9088:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457ff1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3317:x1869199364409600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607705.670638:0:9088:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457ff1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3317:x1869199364409600:12345-0@lo:400:kworker.0 Request processed in 31us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607705.670644:0:9088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1782607705.670661:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364409472 00000100:00100000:1.0:1782607705.670664:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364409472 00000100:00100000:1.0:1782607705.670706:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364409216 00000100:00100000:1.0:1782607705.670709:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364409216 00000100:00100000:1.0:1782607705.670722:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364409088 00000100:00100000:1.0:1782607705.670723:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364409088 00000100:00100000:1.0:1782607705.670734:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1782607705.670739:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457fad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1869199364409472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607705.670789:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457fad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1869199364409472:12345-0@lo:400:kworker.0 Request processed in 50us (4130us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607705.670795:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1782607705.670808:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1782607705.670814:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869199364409216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607705.670839:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869199364409216:12345-0@lo:400:kworker.0 Request processed in 26us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607705.670845:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1782607705.670854:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1782607705.670860:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869199364409088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607705.670896:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869199364409088:12345-0@lo:400:kworker.0 Request processed in 25us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607705.670902:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:1.0:1782607705.670929:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782607705.670934:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782607705.670965:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974541322d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869199364409088:0@lo:400:kworker.0 00000100:00100000:1.0:1782607705.670976:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974580e53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364409600:0@lo:400:kworker.0 00000100:00100000:1.0:1782607705.670985:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745799a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1869199364409216:0@lo:400:kworker.0 00000100:00100000:1.0:1782607705.671052:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364408960 00000100:00100000:1.0:1782607705.671057:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364408960 00000100:00100000:1.0:1782607705.671092:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1782607705.671097:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3319:x1869199364408960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607705.671130:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3319:x1869199364408960:12345-0@lo:400:kworker.0 Request processed in 33us (4552us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607705.671136:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1782607705.685662:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745799a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364409344:0@lo:400:kworker.0 00000100:00100000:3.0:1782607705.685677:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974541320a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364408960:0@lo:400:kworker.0 00000100:00100000:3.0:1782607705.685688:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745799a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1869199364409472:0@lo:400:kworker.0 00000040:00080000:2.0:1782607705.771581:0:12442:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782607705.771596:0:12442:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782607705.771646:0:12442:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1782607705.771654:0:12442:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782607705.991609:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607705.991800:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342405760 00000100:00100000:1.0:1782607705.991814:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342405760 00000100:00100000:1.0:1782607705.991875:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 236 00000100:00100000:1.0:1782607705.991894:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457fad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+30:11628:x1869199342405760:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1782607705.991920:0:7437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607705.992148:0:7437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cc0e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b5862a00053 expref: -99 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607705.992267:0:7437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cc0ec lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607705.992282:0:7437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cc0ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607705.992292:0:7437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cc0ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782607705.992433:0:7437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1782607705.992571:0:7437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467600/0x8109266df35cc0e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00053 expref: 33 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607705.992587:0:7437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cc0ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00053 expref: 32 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607705.992676:0:7437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97454be19300) 00010000:00010000:1.0:1782607705.992678:0:7437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1782607705.992681:0:7437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97457f467c00, rc 0) 00000100:00100000:1.0:1782607705.992739:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457fad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+32:11628:x1869199342405760:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 856us (1147us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1782607705.992747:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 236 00000100:00100000:0.0:1782607705.999971:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607706.000059:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342405888 00000100:00100000:1.0:1782607706.000070:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342405888 00000100:00100000:1.0:1782607706.000127:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 237 00000100:00100000:1.0:1782607706.000139:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457fad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+32:11628:x1869199342405888:12345-192.168.202.4@tcp:54:lfs.0 00010000:00010000:1.0:1782607706.000227:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cc0fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607706.000248:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cc0fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607706.000260:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cc0fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607706.000285:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cc0fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607706.000293:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cc0fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607706.000311:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cc0fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607706.000317:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f466a00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607706.000338:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cc0fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607706.000346:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cc0fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607706.000358:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97454be19300) 00010000:00010000:1.0:1782607706.000361:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782607706.000366:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cc0fa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607706.000372:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466a00/0x8109266df35cc0fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607706.000444:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457fad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+32:11628:x1869199342405888:12345-192.168.202.4@tcp:54:lfs.0 Request processed in 306us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607706.000452:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 237 00000100:00100000:0.0:1782607706.137163:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607706.150560:0:9088:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342406016 00000100:00100000:1.0:1782607706.150576:0:9088:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342406016 00000100:00080000:2.0:1782607706.150684:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782607706.150684:0:9088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 71 00000100:00100000:1.0:1782607706.150700:0:9088:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457fad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:2356:x1869199342406016:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:1.0:1782607706.150719:0:9088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607706.150737:0:9088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013ff735a/0x8109266df35cc101 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b5862a0005a expref: -99 pid: 9088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782607706.150788:0:9088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a406f58, atime: 0x6a406f57, ctime: 0x6a406f58, blocks: 0xb 00010000:00010000:1.0:1782607706.150810:0:9088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=364s v=(0 0) 00010000:00010000:1.0:1782607706.150815:0:9088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607706.150825:0:9088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013ff735a/0x8109266df35cc101 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0005a expref: 8 pid: 9088 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607706.150859:0:9088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000013ff735a/0x8109266df35cc101 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0005a expref: 8 pid: 9088 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607706.150872:0:9088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97457f466a00, rc 0) 00000100:00100000:1.0:1782607706.150972:0:9088:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457fad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+8:2356:x1869199342406016:12345-192.168.202.4@tcp:101:cat.0 Request processed in 277us (13819us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607706.150980:0:9088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 71 00000100:00100000:1.0:1782607706.156622:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607706.163325:0:6616:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342406144 00000100:00100000:3.0:1782607706.163348:0:6616:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342406144 00002000:00100000:2.0:1782607706.167440:0:6616:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9745799a4380 x1869199342406144/t0(0) o3->d72d7fb9-639f-4ad9-b658-df715cbf7792@192.168.202.4@tcp:622/0 lens 488/0 e 0 to 0 dl 1782607717 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782607706.167459:0:6616:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9745799a4380 with x1869199342406144 ext(0->4095) 00002000:00010000:2.0:1782607706.167469:0:6616:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9745799a4380 00000100:00100000:2.0:1782607706.167532:0:6616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8 00000100:00100000:2.0:1782607706.167544:0:6616:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745799a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+8:2357:x1869199342406144:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:2.0:1782607706.168043:0:6616:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745799a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+8:2357:x1869199342406144:12345-192.168.202.4@tcp:3:cat.0 Request processed in 499us (11441us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1782607706.168052:0:6616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8 00002000:00100000:2.0:1782607706.168059:0:6616:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9745799a4380 x1869199342406144/t0(0) o3->d72d7fb9-639f-4ad9-b658-df715cbf7792@192.168.202.4@tcp:622/0 lens 488/4536 e 0 to 0 dl 1782607717 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782607706.168069:0:6616:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9745799a4380 with x1869199342406144 ext(0->4095) 00002000:00010000:2.0:1782607706.168073:0:6616:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9745799a4380 00010000:00010000:2.0:1782607706.370112:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782607706.726304:0:7525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1782607706.726642:0:7525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:3.0:1782607706.726652:0:7525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:0.0:1782607707.379882:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607707.380003:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607707.380037:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607707.380062:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607707.380091:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607707.380192:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342406656 00000100:00100000:1.0:1782607707.380205:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342406656 00000100:00100000:1.0:1782607707.380387:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342406528 00000100:00100000:1.0:1782607707.380392:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342406528 00000100:00100000:1.0:1782607707.380423:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 104 00000100:00100000:1.0:1782607707.380436:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457fad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2357:x1869199342406656:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1782607707.380537:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457fad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2357:x1869199342406656:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 104us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607707.380545:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 104 00000100:00100000:1.0:1782607707.380566:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 105 00000100:00100000:1.0:1782607707.380572:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457fad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+8:2357:x1869199342406528:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1782607707.380601:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457fad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+8:2357:x1869199342406528:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 29us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607707.380608:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 105 00000100:00100000:1.0:1782607707.380628:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342406272 00000100:00100000:1.0:1782607707.380631:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342406272 00000100:00100000:1.0:1782607707.380682:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 302 00000100:00100000:1.0:1782607707.380689:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2357:x1869199342406272:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1782607707.380714:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2357:x1869199342406272:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 26us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607707.380720:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 302 00000100:00080000:1.0:1782607707.380754:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782607707.382222:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342406400 00000100:00100000:3.0:1782607707.382233:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342406400 00000100:00100000:3.0:1782607707.382331:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342406784 00000100:00100000:3.0:1782607707.382335:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342406784 00000100:00080000:1.0:1782607707.382359:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782607707.382442:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 169 00000100:00100000:3.0:1782607707.382452:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457fad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+32:2357:x1869199342406400:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1782607707.382525:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457fad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+32:2357:x1869199342406400:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 74us (2668us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607707.382532:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 169 00000100:00100000:3.0:1782607707.382550:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 170 00000100:00100000:3.0:1782607707.382556:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9744437c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2357:x1869199342406784:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1782607707.382582:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9744437c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2357:x1869199342406784:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 27us (2491us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607707.382588:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 170 00010000:00010000:3.0:1782607707.394308:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782607708.226205:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782607708.226229:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745799a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364409728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782607708.226303:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607708.226446:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364409728 00000100:00100000:0.0:1782607708.226455:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364409728 00000100:00100000:0.0:1782607708.226534:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1782607708.226545:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364409728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782607708.226580:0:6612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782607708.226630:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364409728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607708.226651:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1782607708.226688:0:3316:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1782607708.226695:0:3316:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:0.0:1782607708.226713:0:3316:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97457f46ea00, transno 4294967310 00000100:00100000:0.0:1782607708.226731:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745799a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364409728:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1782607708.227144:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1782607708.418001:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782607709.256259:0:6711:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 368102491237ns, next at 369102488483ns, rc = 0 00000100:00100000:1.0:1782607709.256298:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745799a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364409856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782607709.256388:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607709.256497:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364409856 00000100:00100000:1.0:1782607709.256506:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364409856 00000100:00100000:1.0:1782607709.256570:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1782607709.256581:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745799a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1869199364409856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782607709.256621:0:6612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782607709.256679:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745799a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1869199364409856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607709.256687:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1782607709.256714:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782607709.256755:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745799a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364409856:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782607709.442041:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782607709.811483:0:6634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:3.0:1782607709.811501:0:6634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:0.0:1782607709.826381:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000020:00080000:0.0:1782607709.826402:0:5825:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff974442a7c300 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1782607709.826407:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9745809ffa00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff974442a7c3c0 00000020:00080000:0.0:1782607709.826411:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9745809ffe00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9745585d8400 00000020:00080000:1.0:1782607709.826448:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 5 00000020:00080000:1.0:1782607709.826652:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000004:00080000:0.0:1782607709.827103:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 10 committed 00000100:00100000:1.0:1782607709.828117:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782607709.828141:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745799a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364409984:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1782607709.828219:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607709.828315:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364409984 00000100:00100000:1.0:1782607709.828323:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364409984 00000100:00100000:1.0:1782607709.828370:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782607709.828378:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974580e53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364409984:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1782607709.828620:0:6610:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1782607709.828623:0:6610:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1782607704 -> 1782607704 00002000:00010000:1.0:1782607709.828625:0:6610:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1782607703 -> 1782607703 00002000:00010000:1.0:1782607709.828627:0:6610:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1782607704 -> 1782607704 00002000:00010000:1.0:1782607709.828629:0:6610:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1782607709.828667:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974580e53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3318:x1869199364409984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 288us (447us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1782607709.828673:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782607709.828712:0:3318:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:1.0:1782607709.828717:0:3318:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967323 00000100:00100000:1.0:1782607709.828741:0:3318:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff9745799a6300 x1869199364409984/t4294967324(4294967324) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1782607725 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1782607709.828752:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9745799a6300/2, rc 0, transno 4294967324 00000100:00100000:1.0:1782607709.828757:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745799a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364409984:0@lo:2:osp-syn-0-0.0 00000001:00080000:0.0:1782607709.829081:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1782607709.829110:0:5825:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:3.0:1782607710.470902:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607710.789125:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745675f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fae11c6e-4506-4104-bb8c-df42498f7e08:3316:1869199364410112:0@lo:400:kworker.0 00000100:00100000:1.0:1782607710.789212:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607710.789272:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745675f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869199364410240:0@lo:400:kworker.0 00000100:00100000:1.0:1782607710.789273:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1869199364410624:0@lo:400:kworker.0 00000100:00100000:2.0:1782607710.789321:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607710.789327:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364410112 00000100:00100000:1.0:1782607710.789336:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364410112 00000100:00100000:1.0:1782607710.789378:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1782607710.789386:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3316:x1869199364410112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607710.789427:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3316:x1869199364410112:12345-0@lo:400:kworker.0 Request processed in 41us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607710.789443:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1782607710.789794:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745508c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364410496:0@lo:400:kworker.0 00000100:00100000:3.0:1782607710.789829:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607710.789866:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782607710.789880:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745675f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3319:1869199364410368:0@lo:400:kworker.0 00000100:00100000:3.0:1782607710.789907:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607710.789936:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364410240 00000100:00100000:3.0:1782607710.789940:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364410240 00000100:00100000:3.0:1782607710.789973:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364410368 00000100:00100000:3.0:1782607710.789976:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364410368 00000100:00100000:3.0:1782607710.790010:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1782607710.790017:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457718e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869199364410240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607710.790048:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457718e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869199364410240:12345-0@lo:400:kworker.0 Request processed in 32us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607710.790054:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1782607710.790068:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1782607710.790074:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97454773a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1869199364410368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607710.790102:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97454773a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1869199364410368:12345-0@lo:400:kworker.0 Request processed in 29us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607710.790107:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1782607710.790125:0:9088:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364410496 00000100:00100000:3.0:1782607710.790128:0:9088:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364410496 00000100:00100000:3.0:1782607710.790151:0:9088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1782607710.790156:0:9088:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974547738e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3319:x1869199364410496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607710.790186:0:9088:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974547738e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3319:x1869199364410496:12345-0@lo:400:kworker.0 Request processed in 30us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607710.790192:0:9088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1782607710.790233:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745675f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3319:1869199364410368:0@lo:400:kworker.0 00000100:00100000:3.0:1782607710.790243:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745508c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364410496:0@lo:400:kworker.0 00000100:00080000:1.0:1782607710.790255:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782607710.790495:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364410752:0@lo:400:kworker.0 00000100:00100000:2.0:1782607710.790526:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607710.790562:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745675f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869199364410240:0@lo:400:kworker.0 00000100:00100000:2.0:1782607710.790598:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607710.790631:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745675f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fae11c6e-4506-4104-bb8c-df42498f7e08:3316:1869199364410112:0@lo:400:kworker.0 00000100:00100000:1.0:1782607710.790897:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364410752 00000100:00100000:1.0:1782607710.790903:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364410752 00000100:00100000:3.0:1782607710.790954:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364410624 00000100:00100000:1.0:1782607710.790960:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1782607710.790966:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364410624 00000100:00100000:1.0:1782607710.790971:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457718ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364410752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607710.791026:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457718ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364410752:12345-0@lo:400:kworker.0 Request processed in 57us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607710.791033:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1782607710.791079:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364410752:0@lo:400:kworker.0 00000100:00100000:3.0:1782607710.791093:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1782607710.791103:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457718df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869199364410624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607710.791146:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457718df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869199364410624:12345-0@lo:400:kworker.0 Request processed in 46us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607710.791155:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:2.0:1782607710.791179:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782607710.791243:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782607710.791385:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1869199364410624:0@lo:400:kworker.0 00010000:00010000:0.0:1782607711.493052:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607711.541513:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607711.541596:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342406912 00000100:00100000:3.0:1782607711.541606:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342406912 00000100:00100000:3.0:1782607711.541674:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 238 00000100:00100000:3.0:1782607711.541686:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+19:11281:x1869199342406912:12345-192.168.202.4@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1782607711.541848:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+19:11281:x1869199342406912:12345-192.168.202.4@tcp:60:lhsmtool_posix.0 Request processed in 155us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607711.541857:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 238 00000100:00080000:2.0:1782607711.542388:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782607711.544452:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607711.544753:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342407168 00000100:00100000:2.0:1782607711.544796:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342407168 00000100:00100000:2.0:1782607711.544860:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 65 00000100:00100000:2.0:1782607711.544871:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974547739880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+19:11281:x1869199342407168:12345-192.168.202.4@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1782607711.546666:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974547739880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+20:11281:x1869199342407168:12345-192.168.202.4@tcp:35:lhsmtool_posix.0 Request processed in 1790us (2214us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1782607711.546677:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 65 00000100:00100000:0.0:1782607711.793929:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607711.796392:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342407296 00000100:00100000:3.0:1782607711.796407:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342407296 00000100:00100000:3.0:1782607711.796568:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 239 00000100:00100000:3.0:1782607711.796580:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9744437c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d45e125-365f-42d9-9f91-770009f5d4b0+5:12080:x1869199342407296:12345-192.168.202.4@tcp:101:lsof.0 00010000:00010000:3.0:1782607711.796603:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607711.796626:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648200/0x8109266df35cc108 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b5862a00061 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607711.796698:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cc10f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607711.796712:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cc10f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607711.796756:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cc10f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782607711.797115:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782607711.797121:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1782607711.797399:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cc10f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607711.797428:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648200/0x8109266df35cc108 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00061 expref: 7 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607711.797446:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cc10f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00061 expref: 6 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607711.797455:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97454be19700) 00010000:00010000:3.0:1782607711.797458:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782607711.797462:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97455d648c00, rc 0) 00000100:00100000:3.0:1782607711.797535:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9744437c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d45e125-365f-42d9-9f91-770009f5d4b0+6:12080:x1869199342407296:12345-192.168.202.4@tcp:101:lsof.0 Request processed in 958us (3615us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607711.797543:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 239 00000100:00080000:2.0:1782607711.797876:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782607712.493120:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607712.493165:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607712.493228:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607712.493248:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607712.493282:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607712.493331:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342407936 00000100:00100000:0.0:1782607712.493339:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342407936 00000100:00100000:0.0:1782607712.493377:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342407552 00000100:00100000:0.0:1782607712.493379:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342407552 00000100:00100000:0.0:1782607712.493393:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 174 00000100:00100000:0.0:1782607712.493400:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d45e125-365f-42d9-9f91-770009f5d4b0+6:2355:x1869199342407936:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1782607712.493458:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d45e125-365f-42d9-9f91-770009f5d4b0+6:2355:x1869199342407936:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 59us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607712.493462:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 174 00000100:00100000:0.0:1782607712.493473:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 175 00000100:00100000:0.0:1782607712.493477:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974541320a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+20:2355:x1869199342407552:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1782607712.493508:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974541320a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+20:2355:x1869199342407552:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 31us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607712.493512:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 175 00000100:00100000:2.0:1782607712.493907:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342407424 00000100:00100000:2.0:1782607712.493913:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342407424 00000100:00100000:2.0:1782607712.493951:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 304 00000100:00100000:2.0:1782607712.493959:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2355:x1869199342407424:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607712.493994:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2355:x1869199342407424:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 37us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607712.494001:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 304 00000100:00100000:3.0:1782607712.496114:0:9088:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342407680 00000100:00100000:3.0:1782607712.496127:0:9088:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342407680 00000100:00080000:1.0:1782607712.496290:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782607712.496326:0:9088:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342407808 00000100:00100000:3.0:1782607712.496333:0:9088:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342407808 00000100:00100000:3.0:1782607712.496378:0:9088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 108 00000100:00100000:3.0:1782607712.496388:0:9088:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581267b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:2355:x1869199342407680:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1782607712.496460:0:9088:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581267b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:2355:x1869199342407680:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 74us (3292us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607712.496482:0:9088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 108 00000100:00100000:3.0:1782607712.496499:0:9088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 109 00000100:00100000:3.0:1782607712.496505:0:9088:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974541322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2355:x1869199342407808:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1782607712.496531:0:9088:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974541322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2355:x1869199342407808:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 26us (3249us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607712.496537:0:9088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 109 00000100:00080000:1.0:1782607712.496684:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1782607712.514323:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782607712.770067:0:11563:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782607712.770078:0:11563:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782607712.770358:0:11563:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1782607712.770365:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782607713.347904:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364410880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782607713.347998:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607713.348092:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364410880 00000100:00100000:1.0:1782607713.348101:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364410880 00000100:00080000:2.0:1782607713.348156:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782607713.348175:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1782607713.348186:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974577609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364410880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782607713.348224:0:6612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782607713.348283:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974577609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364410880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607713.348300:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1782607713.348337:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364410880:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782607713.538274:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782607714.370359:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364411008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782607714.370427:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607714.370530:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364411008 00000100:00100000:0.0:1782607714.370539:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364411008 00000100:00100000:0.0:1782607714.370601:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1782607714.370610:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1869199364411008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782607714.370640:0:6612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1782607714.370798:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782607714.372835:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1869199364411008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2218us (2398us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607714.372850:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1782607714.376929:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364411008:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782607714.562072:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782607714.940713:0:6634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000020:00080000:0.0:1782607714.943964:0:5825:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1782607714.944053:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1782607714.944073:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:0.0:1782607714.944255:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00010000:00010000:0.0:1782607715.595076:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782607715.760104:0:12647:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 20:48:35 (1782607715) 00000100:00100000:3.0:1782607715.906197:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745675f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1869199364411392:0@lo:400:kworker.0 00000100:00100000:3.0:1782607715.906280:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607715.906342:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782607715.906348:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974443368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364411520:0@lo:400:kworker.0 00000100:00100000:3.0:1782607715.906378:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607715.906414:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364411392 00000100:00100000:3.0:1782607715.906423:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364411392 00000100:00100000:3.0:1782607715.906485:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1782607715.906510:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1869199364411392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607715.906565:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1869199364411392:12345-0@lo:400:kworker.0 Request processed in 59us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607715.906571:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1782607715.906596:0:9088:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364411520 00000100:00100000:3.0:1782607715.906599:0:9088:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364411520 00000100:00100000:3.0:1782607715.906631:0:9088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1782607715.906638:0:9088:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97444336a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364411520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607715.906669:0:9088:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97444336a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364411520:12345-0@lo:400:kworker.0 Request processed in 32us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607715.906675:0:9088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:3.0:1782607715.906691:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782607715.906724:0:3318:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1782607715.906730:0:3318:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9745799a6300, transno 4294967324 00000100:00100000:3.0:1782607715.906746:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974443368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364411520:0@lo:400:kworker.0 00000100:00100000:3.0:1782607715.906758:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745675f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1869199364411392:0@lo:400:kworker.0 00000100:00100000:2.0:1782607715.907268:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745675f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869199364411264:0@lo:400:kworker.0 00000100:00100000:2.0:1782607715.907303:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607715.907332:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974443368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364411776:0@lo:400:kworker.0 00000100:00100000:2.0:1782607715.907355:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607715.907383:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1782607715.907389:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745675f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fae11c6e-4506-4104-bb8c-df42498f7e08:3317:1869199364411136:0@lo:400:kworker.0 00000100:00100000:2.0:1782607715.907422:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607715.907444:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974443368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3317:1869199364411648:0@lo:400:kworker.0 00000100:00100000:2.0:1782607715.907465:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607715.907491:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364411776 00000100:00100000:2.0:1782607715.907495:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364411776 00000100:00100000:2.0:1782607715.907531:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1782607715.907538:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457760bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364411776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607715.907577:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457760bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364411776:12345-0@lo:400:kworker.0 Request processed in 40us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607715.907583:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1782607715.907602:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364411264 00000100:00100000:2.0:1782607715.907607:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364411264 00000100:00100000:2.0:1782607715.907629:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364411648 00000100:00100000:2.0:1782607715.907632:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364411648 00000100:00100000:2.0:1782607715.907653:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1782607715.907659:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974577609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869199364411264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607715.907689:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974577609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869199364411264:12345-0@lo:400:kworker.0 Request processed in 30us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607715.907705:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1782607715.907743:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1782607715.907750:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974577609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869199364411648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607715.907822:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974577609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869199364411648:12345-0@lo:400:kworker.0 Request processed in 72us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607715.907827:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:2.0:1782607715.907848:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782607715.907853:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782607715.907874:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974443368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3317:1869199364411648:0@lo:400:kworker.0 00000100:00100000:2.0:1782607715.907884:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745675f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869199364411264:0@lo:400:kworker.0 00000100:00100000:2.0:1782607715.907892:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974443368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364411776:0@lo:400:kworker.0 00000100:00100000:1.0:1782607715.907972:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364411136 00000100:00100000:1.0:1782607715.907976:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364411136 00000100:00100000:1.0:1782607715.908012:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1782607715.908019:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3317:x1869199364411136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607715.908056:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3317:x1869199364411136:12345-0@lo:400:kworker.0 Request processed in 39us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607715.908062:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1782607715.908094:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745675f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fae11c6e-4506-4104-bb8c-df42498f7e08:3317:1869199364411136:0@lo:400:kworker.0 00010000:00010000:1.0:1782607716.610431:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782607717.613815:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607717.613855:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342408064 00000100:00100000:3.0:1782607717.613859:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607717.613867:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342408064 00000100:00100000:3.0:1782607717.613893:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607717.613909:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607717.613918:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 306 00000100:00100000:1.0:1782607717.613927:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2354:x1869199342408064:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1782607717.613929:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607717.613951:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342408320 00000100:00100000:3.0:1782607717.613954:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342408320 00000100:00100000:3.0:1782607717.613986:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342408448 00000100:00100000:3.0:1782607717.613988:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342408448 00000100:00100000:1.0:1782607717.614001:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2354:x1869199342408064:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 75us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607717.614005:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 112 00000100:00100000:1.0:1782607717.614009:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 306 00000100:00100000:3.0:1782607717.614010:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443368380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:2354:x1869199342408320:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1782607717.614052:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443368380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:2354:x1869199342408320:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 41us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607717.614057:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 112 00000100:00100000:3.0:1782607717.614070:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 113 00000100:00100000:3.0:1782607717.614075:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97444336b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2354:x1869199342408448:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1782607717.614111:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97444336b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2354:x1869199342408448:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 36us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607717.614117:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 113 00000100:00100000:2.0:1782607717.614204:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342408576 00000100:00100000:2.0:1782607717.614208:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342408576 00000100:00100000:2.0:1782607717.614247:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342408192 00000100:00100000:2.0:1782607717.614258:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342408192 00000100:00100000:2.0:1782607717.614286:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 179 00000100:00100000:2.0:1782607717.614293:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d45e125-365f-42d9-9f91-770009f5d4b0+6:2354:x1869199342408576:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607717.614327:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d45e125-365f-42d9-9f91-770009f5d4b0+6:2354:x1869199342408576:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 34us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607717.614333:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 179 00000100:00100000:2.0:1782607717.614344:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 180 00000100:00100000:2.0:1782607717.614350:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97444336aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+19:2354:x1869199342408192:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607717.614371:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97444336aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+19:2354:x1869199342408192:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 21us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607717.614387:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 180 00000100:00080000:2.0:1782607717.614405:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782607717.614410:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782607717.614412:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782607717.635178:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782607718.468958:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782607718.468985:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364411904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782607718.469054:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607718.470339:0:6613:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364411904 00000100:00100000:1.0:1782607718.470354:0:6613:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364411904 00000100:00100000:1.0:1782607718.470437:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1782607718.470449:0:6613:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9744437c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364411904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782607718.470490:0:6613:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782607718.470574:0:6613:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9744437c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364411904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (1519us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607718.470582:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1782607718.470635:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364411904:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1782607718.471978:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1782607718.657995:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782607719.490453:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782607719.490475:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364412032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782607719.490538:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607719.490685:0:6613:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364412032 00000100:00100000:1.0:1782607719.490692:0:6613:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364412032 00000100:00100000:1.0:1782607719.490747:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1782607719.490755:0:6613:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457760ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364412032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782607719.490825:0:6613:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1782607719.490929:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782607719.490999:0:6613:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457760ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364412032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 244us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607719.491018:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1782607719.495466:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364412032:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782607719.681946:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782607720.383367:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607720.384062:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342408832 00000100:00100000:2.0:1782607720.384076:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342408832 00000100:00100000:2.0:1782607720.384182:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 66 00000100:00100000:2.0:1782607720.384198:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97444336a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+19:12302:x1869199342408832:12345-192.168.202.4@tcp:35:umount.0 00000100:00080000:0.0:1782607720.384211:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782607720.385383:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97444336a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+20:12302:x1869199342408832:12345-192.168.202.4@tcp:35:umount.0 Request processed in 1182us (2024us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1782607720.385397:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 66 00000100:00100000:2.0:1782607720.394278:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607720.394496:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342409088 00000100:00100000:3.0:1782607720.394507:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342409088 00000100:00100000:3.0:1782607720.394639:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 67 00000100:00100000:3.0:1782607720.394650:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457760b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+20:12302:x1869199342409088:12345-192.168.202.4@tcp:35:umount.0 00000100:00100000:3.0:1782607720.395133:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457760b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+21:12302:x1869199342409088:12345-192.168.202.4@tcp:35:umount.0 Request processed in 483us (863us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1782607720.395141:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 67 00000100:00100000:1.0:1782607720.397883:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607720.402482:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342409344 00000100:00100000:2.0:1782607720.402497:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342409344 00000100:00100000:2.0:1782607720.402599:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 68 00000100:00100000:2.0:1782607720.402610:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549b88850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+21:12302:x1869199342409344:12345-192.168.202.4@tcp:35:umount.0 00000100:00100000:2.0:1782607720.403383:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549b88850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d7fb9-639f-4ad9-b658-df715cbf7792+22:12302:x1869199342409344:12345-192.168.202.4@tcp:35:umount.0 Request processed in 771us (5505us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1782607720.403393:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 68 00000100:00100000:0.0:1782607720.407135:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607720.407328:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342409600 00000100:00100000:1.0:1782607720.407390:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342409600 00000100:00100000:1.0:1782607720.407475:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 69 00000100:00100000:1.0:1782607720.407484:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9744437c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+22:12302:x1869199342409600:12345-192.168.202.4@tcp:35:umount.0 00000100:00100000:1.0:1782607720.407869:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9744437c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+23:12302:x1869199342409600:12345-192.168.202.4@tcp:35:umount.0 Request processed in 385us (743us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1782607720.407877:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 69 00000100:00100000:0.0:1782607720.418213:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607720.418262:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607720.418287:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607720.418348:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607720.418381:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342409728 00000100:00100000:0.0:1782607720.418400:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342409728 00000100:00100000:0.0:1782607720.418457:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 73 00000100:00100000:0.0:1782607720.418467:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9744437c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2353:x1869199342409728:12345-192.168.202.4@tcp:9:umount.0 00000020:00000080:0.0:1782607720.418501:0:6609:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8109266df35cb45f 00000100:00080000:0.0:1782607720.418510:0:6609:0:(import.c:65:import_set_state_nolock()) ffff97457772a000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782607720.418548:0:6609:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1782607720.418842:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9744437c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d72d7fb9-639f-4ad9-b658-df715cbf7792+2:2353:x1869199342409728:12345-192.168.202.4@tcp:9:umount.0 Request processed in 375us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607720.418850:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 73 00010000:00010000:0.0:1782607720.418876:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782607720.418884:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782607720.419068:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342409856 00000100:00100000:3.0:1782607720.419073:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342409856 00000100:00100000:3.0:1782607720.419099:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342409984 00000100:00100000:3.0:1782607720.419102:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342409984 00000100:00100000:3.0:1782607720.419112:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342410112 00000100:00100000:3.0:1782607720.419114:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342410112 00000100:00100000:3.0:1782607720.419126:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 18 00000100:00100000:3.0:1782607720.419131:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9744437c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+15:2357:x1869199342409856:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782607720.419141:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782607720.419158:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9745585ac000/0x8109266df35cb187 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffbec expref: 15 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607720.419174:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782607720.419198:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9744437c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+14:2357:x1869199342409856:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 67us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607720.419212:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 18 00000100:00100000:3.0:1782607720.419224:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 19 00000100:00100000:3.0:1782607720.419230:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455109cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+13:2357:x1869199342409984:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782607720.419237:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782607720.419246:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9745585aca00/0x8109266df35cb0ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffbb4 expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607720.419256:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782607720.419273:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455109cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+12:2357:x1869199342409984:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 43us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607720.419279:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 19 00000100:00100000:3.0:1782607720.419328:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 20 00000100:00100000:3.0:1782607720.419334:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9744437c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+11:2356:x1869199342410112:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782607720.419341:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782607720.419349:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97455d648400/0x8109266df35cb371 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffcb7 expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607720.419358:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782607720.419374:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9744437c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f69b9a4-d9fb-49e3-b427-4394300cdc40+10:2356:x1869199342410112:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 40us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607720.419379:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 20 00000100:00100000:0.0:1782607720.437155:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607720.438920:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342410496 00000100:00100000:2.0:1782607720.438952:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342410496 00000100:00100000:0.0:1782607720.439210:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 74 00000100:00100000:0.0:1782607720.439222:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9744437c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+7:2353:x1869199342410496:12345-192.168.202.4@tcp:9:umount.0 00000020:00000080:0.0:1782607720.439267:0:6610:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8109266df35cb6c0 00000020:00010000:0.0:1782607720.439275:0:6610:0:(genops.c:1942:obd_stale_export_put()) Put export ffff974580f22000: total 0 00000100:00080000:0.0:1782607720.439279:0:6610:0:(import.c:65:import_set_state_nolock()) ffff974547776000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782607720.439326:0:6610:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1782607720.439607:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9744437c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+5:2353:x1869199342410496:12345-192.168.202.4@tcp:9:umount.0 Request processed in 387us (2464us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607720.439615:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 74 00000100:00080000:2.0:1782607720.440109:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00010000:3.0:1782607720.440443:0:7513:0:(genops.c:1928:obd_stale_export_get()) Get export ffff974580f22000: total 0 00010000:00010000:3.0:1782607720.440490:0:7513:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff974580f22000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1782607720.440545:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ccd1157/0x8109266df35cba63 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe8c expref: 4 pid: 9088 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607720.440608:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013ff735a/0x8109266df35cc101 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0005a expref: 3 pid: 9088 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607720.440623:0:7513:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff974580f22000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1782607720.440636:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607720.440638:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607720.440639:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782607720.452990:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607720.453085:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342411520 00000100:00100000:2.0:1782607720.453094:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342411520 00000100:00100000:2.0:1782607720.453160:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 240 00000100:00100000:2.0:1782607720.453171:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9744437c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+23:2353:x1869199342411520:12345-192.168.202.4@tcp:39:umount.0 00000020:00000080:2.0:1782607720.453209:0:5805:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8109266df35cb0fb 00000020:00010000:2.0:1782607720.453248:0:5805:0:(genops.c:1942:obd_stale_export_put()) Put export ffff974580e4f000: total 0 00000100:00080000:2.0:1782607720.453254:0:5805:0:(import.c:65:import_set_state_nolock()) ffff974580e4c000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782607720.453401:0:5805:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:2.0:1782607720.453838:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9744437c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d7fb9-639f-4ad9-b658-df715cbf7792+22:2353:x1869199342411520:12345-192.168.202.4@tcp:39:umount.0 Request processed in 667us (857us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1782607720.453847:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 240 00000020:00010000:1.0:1782607720.456151:0:5791:0:(genops.c:1928:obd_stale_export_get()) Get export ffff974580e4f000: total 0 00010000:00010000:0.0:1782607720.456940:0:5791:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff974580e4f000, canceled 0 locks, left on hash table 14. 00010000:00010000:0.0:1782607720.456977:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9745432c6d00) 00010000:00010000:0.0:1782607720.456981:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782607720.456991:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f466600/0x8109266df35cba39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe7e expref: 21 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607720.457156:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97454be19300) 00010000:00010000:0.0:1782607720.457159:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782607720.457163:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42c00/0x8109266df35cc0c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00045 expref: 20 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607720.457175:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97454be19700) 00010000:00010000:0.0:1782607720.457177:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782607720.457181:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43800/0x8109266df35cbac5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffea8 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607720.457193:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97454c8e3f00) 00010000:00010000:0.0:1782607720.457195:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782607720.457198:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43a00/0x8109266df35cb3e1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffccc expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607720.457464:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9745432c6d00) 00010000:00010000:0.0:1782607720.457469:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1782607720.457474:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ace00/0x8109266df35cba16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe77 expref: 17 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607720.457490:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9745432c6e00) 00010000:00010000:0.0:1782607720.457493:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782607720.457496:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad600/0x8109266df35cb3c5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffcc5 expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607720.457515:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9745432c6d00) 00010000:00010000:0.0:1782607720.457518:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1782607720.457528:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585acc00/0x8109266df35cba4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe85 expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607720.457543:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97454be19300) 00010000:00010000:0.0:1782607720.457545:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1782607720.457548:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97457f467c00/0x8109266df35cc0ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00053 expref: 14 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607720.457561:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97454be19300) 00010000:00010000:0.0:1782607720.457563:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782607720.457567:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541549a00/0x8109266df35cbfe2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0000d expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607720.457582:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97454c8e3300) 00010000:00010000:0.0:1782607720.457584:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782607720.457588:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cb722 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffdb3 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607720.457597:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97454be19200) 00010000:00010000:0.0:1782607720.457600:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782607720.457603:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c43200/0x8109266df35cbae1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffeaf expref: 11 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607720.457615:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97454be19200) 00010000:00010000:0.0:1782607720.457617:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782607720.457620:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974541549200/0x8109266df35cbdc0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629fff81 expref: 10 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607720.457633:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9745432c6d00) 00010000:00010000:0.0:1782607720.457641:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782607720.457705:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42e00/0x8109266df35cb944 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffe3f expref: 9 pid: 7437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607720.457725:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97454c8e3300) 00010000:00010000:0.0:1782607720.457727:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782607720.457732:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974546c42800/0x8109266df35cb435 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffce1 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607720.457744:0:5791:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff974580e4f000, canceled 14 locks, left on hash table 0. 00010000:00010000:0.0:1782607720.457758:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607720.457760:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607720.458157:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607720.706015:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782607721.026084:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f46ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869199364412288:0@lo:400:kworker.0 00000100:00100000:0.0:1782607721.026101:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974443761880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364412544:0@lo:400:kworker.0 00000100:00100000:1.0:1782607721.026169:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9744437c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fae11c6e-4506-4104-bb8c-df42498f7e08:3316:1869199364412160:0@lo:400:kworker.0 00000100:00100000:3.0:1782607721.026214:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974443760e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1869199364412416:0@lo:400:kworker.0 00000100:00100000:2.0:1782607721.028115:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607721.028204:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974549e7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364412800:0@lo:400:kworker.0 00000100:00100000:2.0:1782607721.029644:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607721.029721:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364412288 00000100:00100000:2.0:1782607721.029728:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364412288 00000100:00100000:2.0:1782607721.030163:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1782607721.030174:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457760b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869199364412288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607721.030593:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457760b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869199364412288:12345-0@lo:400:kworker.0 Request processed in 420us (2483us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607721.030600:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1782607721.030648:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f46ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869199364412288:0@lo:400:kworker.0 00000100:00100000:2.0:1782607721.030696:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364412800 00000100:00100000:2.0:1782607721.030712:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364412800 00000100:00100000:2.0:1782607721.030828:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1782607721.030834:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457760b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364412800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607721.030872:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457760b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364412800:12345-0@lo:400:kworker.0 Request processed in 39us (1232us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607721.030878:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:2.0:1782607721.030897:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782607721.030915:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974549e7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364412800:0@lo:400:kworker.0 00000100:00100000:1.0:1782607721.034910:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607721.034980:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974443762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1869199364412672:0@lo:400:kworker.0 00000100:00100000:1.0:1782607721.035022:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607721.036488:0:5795:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364412160 00000100:00100000:2.0:1782607721.036502:0:5795:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364412160 00000100:00100000:2.0:1782607721.036568:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1782607721.036579:0:5795:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3316:x1869199364412160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607721.036665:0:5795:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3316:x1869199364412160:12345-0@lo:400:kworker.0 Request processed in 87us (1761us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607721.036672:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1782607721.036709:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364412672 00000100:00100000:2.0:1782607721.036713:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364412672 00000100:00100000:2.0:1782607721.036791:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1782607721.036945:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9744437c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fae11c6e-4506-4104-bb8c-df42498f7e08:3316:1869199364412160:0@lo:400:kworker.0 00000100:00080000:1.0:1782607721.036992:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782607721.037963:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f40d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869199364412672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607721.038028:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f40d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869199364412672:12345-0@lo:400:kworker.0 Request processed in 1230us (3005us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607721.038036:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1782607721.038361:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974443762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1869199364412672:0@lo:400:kworker.0 00000100:00100000:3.0:1782607721.040802:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607721.040925:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364412416 00000100:00100000:2.0:1782607721.040935:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364412416 00000100:00100000:2.0:1782607721.040998:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1782607721.041008:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443369c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1869199364412416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607721.041079:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443369c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1869199364412416:12345-0@lo:400:kworker.0 Request processed in 72us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607721.041099:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00080000:3.0:1782607721.041167:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782607721.041188:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974443760e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1869199364412416:0@lo:400:kworker.0 00000100:00100000:0.0:1782607721.043829:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607721.048791:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364412544 00000100:00100000:1.0:1782607721.048805:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364412544 00000100:00100000:1.0:1782607721.048879:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1782607721.048890:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549e7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364412544:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1782607721.048935:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782607721.048995:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549e7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364412544:12345-0@lo:400:kworker.0 Request processed in 107us (5172us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607721.049002:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1782607721.049060:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974443761880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364412544:0@lo:400:kworker.0 00010000:00010000:3.0:1782607721.730072:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1782607722.125172:0:7525:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d72d7fb9-639f-4ad9-b658-df715cbf7792 00000020:00000080:2.0:1782607722.125181:0:7525:0:(genops.c:906:class_export_put()) final put ffff97457772b000/d72d7fb9-639f-4ad9-b658-df715cbf7792 00000020:00000080:0.0:1782607722.125268:0:12572:0:(genops.c:865:class_export_destroy()) destroying export ffff97457772b000/d72d7fb9-639f-4ad9-b658-df715cbf7792 for lustre-OST0001 00000020:00000080:0.0:1782607722.125318:0:12572:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97457772a000 for lustre-OST0001 00000100:00100000:2.0:1782607722.423658:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607722.423697:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607722.423732:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607722.424005:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342411776 00000100:00100000:1.0:1782607722.424015:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342411776 00000100:00100000:1.0:1782607722.424062:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342411648 00000100:00100000:1.0:1782607722.424066:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342411648 00000100:00100000:1.0:1782607722.424076:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342411904 00000100:00100000:1.0:1782607722.424078:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342411904 00000100:00100000:1.0:1782607722.424094:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 21 00000100:00100000:1.0:1782607722.424103:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974577608e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+12:2354:x1869199342411776:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782607722.424119:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782607722.424138:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974546c43e00/0x8109266df35cb1d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc2b expref: 12 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607722.424157:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782607722.424218:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974577608e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+11:2354:x1869199342411776:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 115us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607722.424225:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 21 00000100:00100000:1.0:1782607722.424256:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 22 00000100:00100000:1.0:1782607722.424263:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974577608700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+10:2354:x1869199342411648:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782607722.424272:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782607722.424281:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9745821d0200/0x8109266df35cb1cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffc01 expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607722.424292:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782607722.424309:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974577608700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+9:2354:x1869199342411648:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 47us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607722.424316:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 22 00000100:00100000:1.0:1782607722.424328:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 23 00000100:00100000:1.0:1782607722.424334:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974577608380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+8:2354:x1869199342411904:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782607722.424344:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782607722.424353:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9745585ad400/0x8109266df35cb36a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffcb0 expref: 8 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607722.424361:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782607722.424377:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974577608380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f69b9a4-d9fb-49e3-b427-4394300cdc40+7:2354:x1869199342411904:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 44us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607722.424382:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 23 00000100:00100000:3.0:1782607722.429432:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607722.429499:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342412160 00000100:00100000:1.0:1782607722.429507:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342412160 00000100:00100000:1.0:1782607722.429562:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 241 00000100:00100000:1.0:1782607722.429569:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d45e125-365f-42d9-9f91-770009f5d4b0+6:2353:x1869199342412160:12345-192.168.202.4@tcp:39:umount.0 00000020:00000080:1.0:1782607722.429616:0:7437:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8109266df35cb1e2 00000020:00010000:1.0:1782607722.429622:0:7437:0:(genops.c:1942:obd_stale_export_put()) Put export ffff97454425e000: total 0 00000100:00080000:1.0:1782607722.429625:0:7437:0:(import.c:65:import_set_state_nolock()) ffff97454425c000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782607722.429667:0:7437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:1.0:1782607722.429913:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d45e125-365f-42d9-9f91-770009f5d4b0+5:2353:x1869199342412160:12345-192.168.202.4@tcp:39:umount.0 Request processed in 343us (490us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1782607722.429922:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 241 00000020:00010000:0.0:1782607722.430099:0:5791:0:(genops.c:1928:obd_stale_export_get()) Get export ffff97454425e000: total 0 00010000:00010000:0.0:1782607722.430103:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607722.430139:0:5791:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff97454425e000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1782607722.430170:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97454be19700) 00010000:00010000:0.0:1782607722.430174:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782607722.430182:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648c00/0x8109266df35cc10f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00061 expref: 4 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607722.430205:0:5791:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff97454425e000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1782607722.430225:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607722.430227:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607722.430236:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1782607722.430982:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782607722.468495:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607722.468597:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342412416 00000100:00100000:1.0:1782607722.468616:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342412416 00000100:00100000:1.0:1782607722.468683:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 308 00000100:00100000:1.0:1782607722.468694:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+7:2353:x1869199342412416:12345-192.168.202.4@tcp:251:umount.0 00000020:00000080:1.0:1782607722.468803:0:5797:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8109266df35cb0d8 00000020:00010000:1.0:1782607722.468813:0:5797:0:(genops.c:1942:obd_stale_export_put()) Put export ffff974580e48800: total 0 00000100:00080000:1.0:1782607722.468817:0:5797:0:(import.c:65:import_set_state_nolock()) ffff974580e4a000 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1782607722.469104:0:5790:0:(genops.c:1928:obd_stale_export_get()) Get export ffff974580e48800: total 0 00010000:00010000:0.0:1782607722.469144:0:5790:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff974580e48800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1782607722.469174:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9745821d1400/0x8109266df35cb18e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x6a780b58629ffbf3 expref: 3 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607722.469191:0:5790:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff974580e48800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1782607722.469199:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607722.469201:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607722.469203:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607722.469333:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f69b9a4-d9fb-49e3-b427-4394300cdc40+1:2353:x1869199342412416:12345-192.168.202.4@tcp:251:umount.0 Request processed in 640us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607722.469341:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 308 00000020:00000080:1.0:1782607722.469350:0:5797:0:(genops.c:906:class_export_put()) final put ffff974580e48800/0f69b9a4-d9fb-49e3-b427-4394300cdc40 00000020:00000080:0.0:1782607722.469436:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff974580e48800/0f69b9a4-d9fb-49e3-b427-4394300cdc40 for MGS 00000020:00000080:0.0:1782607722.469488:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff974580e4a000 for MGS 00010000:00010000:3.0:1782607722.755941:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782607723.011986:0:11563:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782607723.011996:0:11563:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782607723.012355:0:11563:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1782607723.012363:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782607723.586179:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364412928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782607723.586257:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607723.586971:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364412928 00000100:00100000:1.0:1782607723.586979:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364412928 00000100:00080000:3.0:1782607723.587012:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782607723.587060:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1782607723.587070:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974577608a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364412928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782607723.587106:0:6612:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782607723.587162:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974577608a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364412928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607723.587169:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1782607723.593054:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364412928:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782607723.777917:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1782607723.998762:0:12849:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1782607724.043322:0:12849:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1782607724.043373:0:12849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974540031e00/0x8109266df35cb15d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb164 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607724.043387:0:12849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974540031e00/0x8109266df35cb15d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cb164 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607724.043395:0:12849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974540031e00/0x8109266df35cb15d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x8109266df35cb164 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607724.043402:0:12849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff974540031e00/0x8109266df35cb15d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x8109266df35cb164 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607724.043431:0:12849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1782607724.043449:0:12849:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1782607724.043473:0:12849:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1782607724.043478:0:12849:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1782607724.043483:0:12849:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1782607724.043508:0:12849:0:(import.c:65:import_set_state_nolock()) ffff974551162800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1782607724.043633:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974577608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869199364413056:0@lo:39:umount.0 00000100:00100000:1.0:1782607724.043701:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607724.043943:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364413056 00000100:00100000:2.0:1782607724.043950:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364413056 00000100:00100000:2.0:1782607724.044004:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1782607724.044076:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f40d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869199364413056:12345-0@lo:39:umount.0 00000020:00000080:2.0:1782607724.044102:0:5803:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8109266df35caee7 00000100:00080000:2.0:1782607724.044109:0:5803:0:(import.c:65:import_set_state_nolock()) ffff97457993d000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1782607724.044166:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f40d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3315:x1869199364413056:12345-0@lo:39:umount.0 Request processed in 154us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607724.044174:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:2.0:1782607724.044183:0:5803:0:(genops.c:906:class_export_put()) final put ffff97456fd53000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:1.0:1782607724.044258:0:3315:0:(import.c:65:import_set_state_nolock()) ffff974551162800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1782607724.044273:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974577608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869199364413056:0@lo:39:umount.0 00000100:00080000:2.0:1782607724.044381:0:12849:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1782607724.044384:0:12849:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1782607724.044388:0:12849:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1782607724.046128:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782607724.046140:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974540031e00/0x8109266df35cb15d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x8109266df35cb164 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607724.046152:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974540031e00 already unused, calling callback (ffffffffc1db0c20) 10000000:00010000:0.0:1782607724.046156:0:5790:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974540031e00/0x8109266df35cb15d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x8109266df35cb164 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607724.046167:0:5790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974540031e00/0x8109266df35cb15d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x8109266df35cb164 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782607724.046174:0:5790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974540031e00/0x8109266df35cb15d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x8109266df35cb164 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782607724.046181:0:5790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1782607724.046194:0:5790:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1782607724.046197:0:5790:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1782607724.046240:0:5790:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974540031e00/0x8109266df35cb15d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8109266df35cb164 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607724.046247:0:5790:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782607724.046276:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974540031e00/0x8109266df35cb15d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8109266df35cb164 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607724.046284:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974540031e00/0x8109266df35cb15d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8109266df35cb164 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607724.046298:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607724.046300:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607724.046302:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782607724.046314:0:12572:0:(genops.c:865:class_export_destroy()) destroying export ffff97456fd53000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1782607724.046362:0:12572:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97457993d000 for lustre-MDT0000 00000100:00100000:0.0:1782607724.046375:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782607724.046391:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974549e7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fae11c6e-4506-4104-bb8c-df42498f7e08:3318:1869199364413184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782607724.046456:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782607724.046815:0:12849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97455d648800/0x8109266df35cb16b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb172 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607724.046827:0:12849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97455d648800/0x8109266df35cb16b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cb172 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607724.046834:0:12849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97455d648800/0x8109266df35cb16b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x8109266df35cb172 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607724.046841:0:12849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff97455d648800/0x8109266df35cb16b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x8109266df35cb172 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607724.046864:0:12849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782607724.046871:0:12849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9745821d0000/0x8109266df35cb092 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb099 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607724.046878:0:12849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9745821d0000/0x8109266df35cb092 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cb099 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607724.046884:0:12849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9745821d0000/0x8109266df35cb092 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8109266df35cb099 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607724.046890:0:12849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff9745821d0000/0x8109266df35cb092 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8109266df35cb099 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607724.046899:0:12849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1782607724.046905:0:12849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974546c43c00/0x8109266df35cb394 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb39b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607724.046911:0:12849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974546c43c00/0x8109266df35cb394 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cb39b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607724.046917:0:12849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974546c43c00/0x8109266df35cb394 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8109266df35cb39b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607724.046923:0:12849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff974546c43c00/0x8109266df35cb394 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8109266df35cb39b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607724.046930:0:12849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1782607724.046934:0:12849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974540030c00/0x8109266df35cae46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cae4d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607724.046946:0:12849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974540030c00/0x8109266df35cae46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cae4d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607724.046952:0:12849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974540030c00/0x8109266df35cae46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8109266df35cae4d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607724.046958:0:12849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff974540030c00/0x8109266df35cae46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8109266df35cae4d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607724.046965:0:12849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1782607724.046968:0:12849:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1782607724.046991:0:12849:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1782607724.046995:0:12849:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1782607724.046998:0:12849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782607724.047003:0:12849:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:2.0:1782607724.047008:0:12849:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff97457fb82000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000100:00100000:1.0:1782607724.047136:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364413184 00000100:00100000:1.0:1782607724.047143:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364413184 00000100:00100000:1.0:1782607724.047194:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1782607724.047203:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549e7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3318:x1869199364413184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782607724.047229:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782607724.047243:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974540031a00/0x8109266df35cb164 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8109266df35cb15d expref: 19 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607724.047255:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782607724.047294:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549e7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+18:3318:x1869199364413184:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607724.047302:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1782607724.047339:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974549e7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fae11c6e-4506-4104-bb8c-df42498f7e08:3318:1869199364413184:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1782607724.047495:0:12849:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff97457f841000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1782607724.047503:0:12849:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff97454425e000 5d45e125-365f-42d9-9f91-770009f5d4b0 192.168.202.4@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1782607724.047508:0:12849:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff974580e4f000 d72d7fb9-639f-4ad9-b658-df715cbf7792 192.168.202.4@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967520 stale:0 00000020:00080000:2.0:1782607724.047512:0:12849:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff97458150cd40) has exports, disconnecting them 00000020:00080000:2.0:1782607724.047517:0:12849:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97457fb82000), last request at 1782607721 00000020:00000080:2.0:1782607724.047523:0:12849:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8109266df35cb05a 00000100:00080000:2.0:1782607724.047538:0:12849:0:(import.c:65:import_set_state_nolock()) ffff97457fb87000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1782607724.047577:0:12849:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97457fb82000): rc 0 00000020:00000080:2.0:1782607724.047580:0:12849:0:(genops.c:906:class_export_put()) final put ffff97457fb82000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:0.0:1782607724.047759:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1782607724.047782:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff97455d648800/0x8109266df35cb16b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x8109266df35cb172 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607724.047790:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d648800 already unused, calling callback (ffffffffc1db0c20) 10000000:00010000:0.0:1782607724.047794:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff97455d648800/0x8109266df35cb16b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x8109266df35cb172 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607724.047802:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff97455d648800/0x8109266df35cb16b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x8109266df35cb172 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782607724.047820:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff97455d648800/0x8109266df35cb16b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x8109266df35cb172 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782607724.047826:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1782607724.047828:0:5791:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:0.0:1782607724.047830:0:5791:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:0.0:1782607724.047851:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff97455d648800/0x8109266df35cb16b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8109266df35cb172 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607724.047858:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782607724.047875:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff97455d648800/0x8109266df35cb16b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8109266df35cb172 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607724.047882:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff97455d648800/0x8109266df35cb16b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8109266df35cb172 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607724.047893:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782607724.047896:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff9745821d0000/0x8109266df35cb092 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8109266df35cb099 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607724.047901:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745821d0000 already unused, calling callback (ffffffffc1db0c20) 10000000:00010000:0.0:1782607724.047903:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff9745821d0000/0x8109266df35cb092 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8109266df35cb099 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607724.047909:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff9745821d0000/0x8109266df35cb092 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8109266df35cb099 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782607724.047914:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff9745821d0000/0x8109266df35cb092 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8109266df35cb099 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782607724.047928:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1782607724.047931:0:5791:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1782607724.047932:0:5791:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1782607724.047946:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff9745821d0000/0x8109266df35cb092 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8109266df35cb099 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607724.047952:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782607724.047958:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff9745821d0000/0x8109266df35cb092 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8109266df35cb099 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607724.047965:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff9745821d0000/0x8109266df35cb092 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8109266df35cb099 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607724.047978:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782607724.047982:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974546c43c00/0x8109266df35cb394 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8109266df35cb39b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607724.047988:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c43c00 already unused, calling callback (ffffffffc1db0c20) 10000000:00010000:0.0:1782607724.047991:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974546c43c00/0x8109266df35cb394 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8109266df35cb39b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607724.047997:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974546c43c00/0x8109266df35cb394 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8109266df35cb39b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782607724.048004:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974546c43c00/0x8109266df35cb394 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8109266df35cb39b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782607724.048009:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1782607724.048084:0:5791:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1782607724.048086:0:5791:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1782607724.048165:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974546c43c00/0x8109266df35cb394 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8109266df35cb39b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607724.048171:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782607724.048180:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974546c43c00/0x8109266df35cb394 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8109266df35cb39b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607724.048186:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974546c43c00/0x8109266df35cb394 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8109266df35cb39b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607724.048195:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782607724.048199:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974540030c00/0x8109266df35cae46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8109266df35cae4d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607724.048204:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974540030c00 already unused, calling callback (ffffffffc1db0c20) 10000000:00010000:0.0:1782607724.048207:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974540030c00/0x8109266df35cae46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8109266df35cae4d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1782607724.048296:0:12849:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97457f841000), last request at 1782607721 00000020:00000080:2.0:1782607724.048318:0:12849:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8109266df35caf8f 00000100:00080000:2.0:1782607724.048323:0:12849:0:(import.c:65:import_set_state_nolock()) ffff97457f846000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1782607724.048487:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974540030c00/0x8109266df35cae46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8109266df35cae4d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782607724.048493:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974540030c00/0x8109266df35cae46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8109266df35cae4d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782607724.048498:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1782607724.048500:0:5791:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1782607724.048501:0:5791:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1782607724.048514:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974540030c00/0x8109266df35cae46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8109266df35cae4d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607724.048519:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782607724.048526:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974540030c00/0x8109266df35cae46 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8109266df35cae4d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607724.048537:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974540030c00/0x8109266df35cae46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8109266df35cae4d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607724.048549:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607724.048551:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607724.048553:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782607724.048568:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974549e7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fae11c6e-4506-4104-bb8c-df42498f7e08:3317:1869199364413440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782607724.048717:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974549e7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fae11c6e-4506-4104-bb8c-df42498f7e08:3316:1869199364413312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782607724.048762:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974549e7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364413696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782607724.048800:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607724.048840:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782607724.048846:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974549e7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364413568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782607724.048867:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607724.048891:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364413696 00000100:00100000:1.0:1782607724.048897:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364413696 00000100:00100000:1.0:1782607724.048922:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364413568 00000100:00100000:1.0:1782607724.048925:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364413568 00000100:00100000:1.0:1782607724.048939:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782607724.048947:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f40ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+19:3319:x1869199364413696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782607724.048957:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782607724.048974:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974540030a00/0x8109266df35cae4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8109266df35cae46 expref: 19 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607724.048987:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782607724.049092:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f40ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+18:3319:x1869199364413696:12345-0@lo:103:ldlm_bl.0 Request processed in 144us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607724.049099:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782607724.049115:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782607724.049121:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f40f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+17:3319:x1869199364413568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782607724.049130:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782607724.049138:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974546c43600/0x8109266df35cb39b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8109266df35cb394 expref: 17 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607724.049147:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782607724.049168:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f40f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fae11c6e-4506-4104-bb8c-df42498f7e08+16:3319:x1869199364413568:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607724.049174:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000020:00000080:1.0:1782607724.049192:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97457fb82000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00080000:2.0:1782607724.049368:0:12849:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97457f841000): rc 0 00000020:00000080:2.0:1782607724.049371:0:12849:0:(genops.c:906:class_export_put()) final put ffff97457f841000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1782607724.049383:0:12849:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffba98c2f5bae0 00000100:00080000:2.0:1782607724.049403:0:12849:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1782607724.049407:0:12849:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000100:00100000:0.0:1782607724.049503:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782607724.049535:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782607724.049575:0:12849:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:1.0:1782607724.049723:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97457fb87000 for lustre-MDT0000 00000020:00000080:1.0:1782607724.049730:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97457f841000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1782607724.049785:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97457f846000 for lustre-MDT0000 00000100:00100000:1.0:1782607724.049800:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607724.049842:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974549e7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364413568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782607724.049851:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974549e7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fae11c6e-4506-4104-bb8c-df42498f7e08:3319:1869199364413696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782607724.049876:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364413440 00000100:00100000:1.0:1782607724.049879:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364413440 00000100:00100000:1.0:1782607724.049898:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364413312 00000100:00100000:1.0:1782607724.049907:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364413312 00000100:00100000:1.0:1782607724.049924:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782607724.049930:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549e7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+17:3317:x1869199364413440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782607724.049938:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782607724.049946:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974582051000/0x8109266df35cb099 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8109266df35cb092 expref: 17 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607724.049957:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782607724.049986:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549e7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+16:3317:x1869199364413440:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (1365us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607724.049991:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782607724.050003:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782607724.050009:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455109c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+15:3316:x1869199364413312:12345-0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1782607724.050155:0:12849:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1782607724.050174:0:12849:0:(import.c:65:import_set_state_nolock()) ffff97456fc9b000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1782607724.050189:0:12849:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1782607724.050192:0:12849:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1782607724.050202:0:12849:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1782607724.050384:0:12849:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1782607724.050395:0:12849:0:(import.c:65:import_set_state_nolock()) ffff97457fa05000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1782607724.050893:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607724.051314:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782607724.051326:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9745585ad800/0x8109266df35cb172 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8109266df35cb16b expref: 15 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607724.051339:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782607724.051557:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455109c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fae11c6e-4506-4104-bb8c-df42498f7e08+14:3316:x1869199364413312:12345-0@lo:103:ldlm_bl.0 Request processed in 1547us (1755us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607724.051566:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782607724.051710:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974577609180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1869199364413824:0@lo:9:umount.0 00000100:00100000:1.0:1782607724.051752:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607724.051799:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457760a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1869199364413952:0@lo:9:umount.0 00000100:00100000:1.0:1782607724.051821:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607724.051874:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974549e7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fae11c6e-4506-4104-bb8c-df42498f7e08:3317:1869199364413440:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1782607724.051948:0:12849:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff97458150cd40) has no exports 00000100:00100000:3.0:1782607724.051984:0:9088:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364413824 00000100:00100000:3.0:1782607724.051990:0:9088:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364413824 00000100:00100000:3.0:1782607724.052096:0:9088:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364413952 00000100:00100000:3.0:1782607724.052100:0:9088:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364413952 00000100:00100000:3.0:1782607724.052123:0:9088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1782607724.052130:0:9088:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f40e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1869199364413824:12345-0@lo:9:umount.0 00000020:00000080:3.0:1782607724.052152:0:9088:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8109266df35cafea 00000100:00080000:3.0:1782607724.052160:0:9088:0:(import.c:65:import_set_state_nolock()) ffff97457fa02800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782607724.052193:0:9088:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1782607724.053129:0:9088:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f40e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3315:x1869199364413824:12345-0@lo:9:umount.0 Request processed in 997us (1374us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607724.053138:0:9088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1782607724.053155:0:9088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1782607724.053163:0:9088:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f40dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1869199364413952:12345-0@lo:9:umount.0 00000020:00000080:3.0:1782607724.053179:0:9088:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8109266df35cb0c3 00000100:00080000:3.0:1782607724.053185:0:9088:0:(import.c:65:import_set_state_nolock()) ffff974580e4e800 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1782607724.053382:0:3315:0:(import.c:65:import_set_state_nolock()) ffff97456fc9b000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1782607724.053413:0:3315:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1782607724.053416:0:3315:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000001:00000004:3.0:1782607724.053481:0:9088:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00080000:0.0:1782607724.053826:0:5799:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782607724.053836:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607724.053842:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607724.053879:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974577609180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1869199364413824:0@lo:9:umount.0 00000100:00100000:2.0:1782607724.054115:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974549e7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fae11c6e-4506-4104-bb8c-df42498f7e08:3316:1869199364413312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782607724.054338:0:9088:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f40dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3315:x1869199364413952:12345-0@lo:9:umount.0 Request processed in 1175us (2514us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607724.054346:0:9088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1782607724.054976:0:3315:0:(import.c:65:import_set_state_nolock()) ffff97457fa05000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1782607724.054987:0:3315:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1782607724.054989:0:3315:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1782607724.054992:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457760a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1869199364413952:0@lo:9:umount.0 00000020:00080000:0.0:1782607724.065044:0:12849:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff97458150cd40) has no exports 00000020:00000080:0.0:1782607724.115346:0:12849:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8109266df35caea1 00000020:00000080:0.0:1782607724.115363:0:12849:0:(genops.c:906:class_export_put()) final put ffff974580c0d800/lustre-QMT0000_UUID 00000020:01000000:0.0:1782607724.115432:0:12849:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1782607724.115680:0:12849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782607724.115691:0:12849:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1782607724.115696:0:12849:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9745443199c0) has no exports 00000020:00000080:1.0:1782607724.120086:0:12572:0:(genops.c:865:class_export_destroy()) destroying export ffff974580c0d800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1782607724.120612:0:12849:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8109266df35cae9a 00000020:00000080:3.0:1782607724.120682:0:12849:0:(genops.c:906:class_export_put()) final put ffff97457993c000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1782607724.126266:0:12572:0:(genops.c:865:class_export_destroy()) destroying export ffff97457993c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1782607724.127692:0:12849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782607724.127707:0:12849:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1782607724.127712:0:12849:0:(genops.c:906:class_export_put()) final put ffff974579939800/lustre-QMT0000_UUID 00000020:00000080:2.0:1782607724.127717:0:12849:0:(genops.c:865:class_export_destroy()) destroying export ffff974579939800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1782607724.127729:0:12849:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:3.0:1782607724.803738:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1782607725.174854:0:6634:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d72d7fb9-639f-4ad9-b658-df715cbf7792 00000020:00000080:1.0:1782607725.174864:0:6634:0:(genops.c:906:class_export_put()) final put ffff974580f22000/d72d7fb9-639f-4ad9-b658-df715cbf7792 00000001:00100000:2.0:1782607725.177250:0:5825:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5d45e125-365f-42d9-9f91-770009f5d4b0 00000001:00080000:2.0:1782607725.177271:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1782607725.177276:0:5825:0:(genops.c:906:class_export_put()) final put ffff97454425e000/5d45e125-365f-42d9-9f91-770009f5d4b0 00000020:00000080:0.0:1782607725.177480:0:12572:0:(genops.c:865:class_export_destroy()) destroying export ffff974580f22000/d72d7fb9-639f-4ad9-b658-df715cbf7792 for lustre-OST0000 00000020:00000080:1.0:1782607725.177734:0:12572:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff974547776000 for lustre-OST0000 00000001:00100000:0.0:1782607725.177794:0:6634:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1782607725.177799:0:6634:0:(genops.c:906:class_export_put()) final put ffff97457fa05800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1782607725.177848:0:12572:0:(genops.c:865:class_export_destroy()) destroying export ffff97457fa05800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1782607725.177880:0:12572:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97457fa02800 for lustre-OST0000 00000001:00080000:2.0:1782607725.177999:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:2.0:1782607725.178013:0:5825:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d72d7fb9-639f-4ad9-b658-df715cbf7792 00000001:00080000:2.0:1782607725.178031:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:2.0:1782607725.178041:0:5825:0:(genops.c:906:class_export_put()) final put ffff974580e4f000/d72d7fb9-639f-4ad9-b658-df715cbf7792 00000020:00000080:0.0:1782607725.178109:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97454425e000/5d45e125-365f-42d9-9f91-770009f5d4b0 for lustre-MDT0000 00000020:00000080:0.0:1782607725.178160:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97454425c000 for lustre-MDT0000 00000020:00000080:1.0:1782607725.178279:0:12572:0:(genops.c:865:class_export_destroy()) destroying export ffff974580e4f000/d72d7fb9-639f-4ad9-b658-df715cbf7792 for lustre-MDT0000 00000020:00000080:1.0:1782607725.178374:0:12572:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff974580e4c000 for lustre-MDT0000 00010000:00010000:0.0:1782607725.829374:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607726.146038:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782607726.146062:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1869199364414336:0@lo:400:kworker.0 00000100:00100000:1.0:1782607726.146140:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607726.146223:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364414336 00000100:00100000:1.0:1782607726.146232:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364414336 00000100:00100000:1.0:1782607726.146273:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1782607726.146280:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f40ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3319:x1869199364414336:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1782607726.146287:0:7437:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1782607726.146325:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f40ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3319:x1869199364414336:12345-0@lo:400:kworker.0 Request processed in 43us (185us total) trans 0 rc -107/-107 00000100:00100000:1.0:1782607726.146332:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:1.0:1782607726.146370:0:3319:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1782607726.146388:0:3319:0:(import.c:65:import_set_state_nolock()) ffff974550539000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1782607726.146392:0:3319:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1782607726.147018:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1869199364414208:0@lo:400:kworker.0 00000100:00100000:0.0:1782607726.147051:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607726.147080:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782607726.147086:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fae11c6e-4506-4104-bb8c-df42498f7e08:3317:1869199364414080:0@lo:400:kworker.0 00000100:00100000:0.0:1782607726.147116:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607726.147194:0:5798:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364414080 00000100:00100000:0.0:1782607726.147199:0:5798:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364414080 00000100:00100000:0.0:1782607726.147228:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1782607726.147234:0:5798:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745489e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+14:3317:x1869199364414080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607726.147273:0:5798:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745489e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fae11c6e-4506-4104-bb8c-df42498f7e08+14:3317:x1869199364414080:12345-0@lo:400:kworker.0 Request processed in 39us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607726.147279:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1782607726.147312:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fae11c6e-4506-4104-bb8c-df42498f7e08:3317:1869199364414080:0@lo:400:kworker.0 00000100:00100000:2.0:1782607726.148522:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364414208 00000100:00100000:2.0:1782607726.148530:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364414208 00000100:00100000:2.0:1782607726.148565:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1782607726.148571:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549e7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3317:x1869199364414208:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1782607726.148578:0:5803:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1782607726.148639:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549e7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3317:x1869199364414208:12345-0@lo:400:kworker.0 Request processed in 67us (1587us total) trans 0 rc -107/-107 00000100:00100000:2.0:1782607726.148645:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000020:01000000:2.0:1782607726.148686:0:12849:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97444379e1e0 - data ffff974566a17e58/ffff974580da6000 00000020:01000000:2.0:1782607726.148994:0:12849:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97456dee20c0 - data ffff97457180a798/ffff974577995800 00000100:00080000:3.0:1782607726.157940:0:3317:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1782607726.157949:0:3317:0:(import.c:65:import_set_state_nolock()) ffff974577167800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1782607726.157954:0:3317:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1782607726.157961:0:3317:0:(import.c:65:import_set_state_nolock()) ffff974577167800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782607726.157965:0:3317:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 165 00000100:00080000:3.0:1782607726.157973:0:3317:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff974577167800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1782607726.158013:0:3317:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97444336bb80 x1869199364414464/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782607726.158053:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1869199364414208:0@lo:400:kworker.0 00000100:00100000:0.0:1782607726.159881:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97444336bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3315:1869199364414464:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1782607726.159951:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607726.160309:0:7437:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364414464 00000100:00100000:3.0:1782607726.160317:0:7437:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364414464 00000100:00100000:3.0:1782607726.160359:0:7437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1782607726.160379:0:7437:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549e7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3315:x1869199364414464:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1782607726.160397:0:7437:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1782607726.165170:0:3319:0:(import.c:65:import_set_state_nolock()) ffff974550539000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782607726.165182:0:3319:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 184 00000100:00080000:1.0:1782607726.165191:0:3319:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff974550539000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1782607726.165237:0:3319:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97457f40f480 x1869199364414592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782607726.165264:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1869199364414336:0@lo:400:kworker.0 00000100:00100000:0.0:1782607726.165378:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3315:1869199364414592:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1782607726.165448:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607726.165910:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364414592 00000100:00100000:1.0:1782607726.165918:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364414592 00000100:00100000:1.0:1782607726.165955:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1782607726.165962:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549e7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3315:x1869199364414592:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1782607726.165979:0:5803:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1782607726.166022:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549e7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3315:x1869199364414592:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 59us (575us total) trans 0 rc -19/-19 00000100:00100000:1.0:1782607726.166029:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:1.0:1782607726.166081:0:3315:0:(import.c:65:import_set_state_nolock()) ffff974550539000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782607726.166086:0:3315:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1782607726.166089:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3315:1869199364414592:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1782607726.184275:0:7437:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549e7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3315:x1869199364414464:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 23886us (24314us total) trans 0 rc -19/-19 00000100:00100000:3.0:1782607726.184290:0:7437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:1.0:1782607726.184967:0:3315:0:(import.c:65:import_set_state_nolock()) ffff974577167800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782607726.184973:0:3315:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1782607726.184977:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97444336bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3315:1869199364414464:0@lo:38:ptlrpcd_00_01.0 00000001:00000004:2.0:1782607726.187215:0:12849:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:1.0:1782607726.302988:0:12849:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1782607726.302998:0:12849:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:1.0:1782607726.303035:0:12849:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1782607726.303038:0:12849:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1782607726.303654:0:6710:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1782607726.303659:0:6710:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:2.0:1782607726.303670:0:6710:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1782607726.305114:0:12849:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1782607726.305120:0:12849:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:1.0:1782607726.305146:0:12849:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1782607726.305148:0:12849:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1782607726.305613:0:7891:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1782607726.305617:0:7891:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:2.0:1782607726.305624:0:7891:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1782607726.369588:0:12849:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8109266df35cae69 00000020:00000080:3.0:1782607726.369612:0:12849:0:(genops.c:906:class_export_put()) final put ffff974581502800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1782607726.369938:0:12572:0:(genops.c:865:class_export_destroy()) destroying export ffff974581502800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1782607726.371039:0:12849:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8109266df35cae7e 00000020:00000080:3.0:1782607726.371046:0:12849:0:(genops.c:906:class_export_put()) final put ffff974581507000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1782607726.371101:0:12849:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1782607726.371108:0:12849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782607726.371116:0:12849:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1782607726.371120:0:12849:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff974549e699c0) has no exports 00000004:01000000:3.0:1782607726.371260:0:12849:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1782607726.371268:0:12849:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8109266df35cb0bc 00000020:00000080:3.0:1782607726.371272:0:12849:0:(genops.c:906:class_export_put()) final put ffff97457fb84000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1782607726.371745:0:12572:0:(genops.c:865:class_export_destroy()) destroying export ffff974581507000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1782607726.371950:0:12849:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1782607726.371955:0:12849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782607726.371961:0:12849:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1782607726.371964:0:12849:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff974577573380) has no exports 00000020:00000080:3.0:1782607726.371970:0:12849:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8109266df35cb0b5 00000020:00000080:3.0:1782607726.371974:0:12849:0:(genops.c:906:class_export_put()) final put ffff97457fa03800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1782607726.372297:0:12849:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1782607726.372302:0:12849:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1782607726.372306:0:12849:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1782607726.372311:0:12849:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1782607726.372313:0:12849:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1782607726.372340:0:12849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782607726.372346:0:12849:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1782607726.372351:0:12849:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8109266df35cafd5 00000020:00000080:3.0:1782607726.372355:0:12849:0:(genops.c:906:class_export_put()) final put ffff97457fa06000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1782607726.372368:0:12849:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1782607726.372371:0:12849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782607726.372375:0:12849:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1782607726.372378:0:12849:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff97458150b380) has no exports 00000020:00000080:3.0:1782607726.372381:0:12849:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8109266df35cafce 00000020:00000080:3.0:1782607726.372384:0:12849:0:(genops.c:906:class_export_put()) final put ffff97457fa00800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1782607726.372676:0:12572:0:(genops.c:865:class_export_destroy()) destroying export ffff97457fb84000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1782607726.372684:0:12572:0:(genops.c:865:class_export_destroy()) destroying export ffff97457fa03800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1782607726.372689:0:12572:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97457fa05000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1782607726.372694:0:12572:0:(genops.c:906:class_export_put()) final put ffff974580f27000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1782607726.372697:0:12572:0:(genops.c:865:class_export_destroy()) destroying export ffff974580f27000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1782607726.372701:0:12572:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1782607726.372793:0:12572:0:(genops.c:865:class_export_destroy()) destroying export ffff97457fa06000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1782607726.372798:0:12572:0:(genops.c:865:class_export_destroy()) destroying export ffff97457fa00800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1782607726.373009:0:12849:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1782607726.373013:0:12849:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1782607726.373016:0:12849:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:3.0:1782607726.373019:0:12849:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1782607726.373020:0:12849:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1782607726.373054:0:12849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782607726.373060:0:12849:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1782607726.373094:0:12849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782607726.373098:0:12849:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1782607726.373101:0:12849:0:(genops.c:906:class_export_put()) final put ffff97454a73e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1782607726.373103:0:12849:0:(genops.c:865:class_export_destroy()) destroying export ffff97454a73e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1782607726.373107:0:12849:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1782607726.373230:0:12849:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8109266df35cae85 00000020:00000080:3.0:1782607726.373234:0:12849:0:(genops.c:906:class_export_put()) final put ffff974581502000/lustre-MDD0000_UUID 00000020:01000000:3.0:1782607726.373238:0:12849:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1782607726.373241:0:12849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782607726.373244:0:12849:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1782607726.373247:0:12849:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9745815099c0) has no exports 00000020:00000080:3.0:1782607726.373264:0:12849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782607726.373267:0:12849:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1782607726.373270:0:12849:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8109266df35cae8c 00000020:00000080:3.0:1782607726.373273:0:12849:0:(genops.c:906:class_export_put()) final put ffff974581503000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1782607726.373280:0:12849:0:(tgt_mount.c:187:server_put_mount()) put mount ffff974544151000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1782607726.373282:0:12849:0:(obd_mount.c:701:lustre_put_lsi()) put ffff974544151000 3 00000020:01000004:3.0:1782607726.373285:0:12849:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff974544151000 from lustre-MDT0000 00000020:00000080:3.0:1782607726.373300:0:12849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782607726.373310:0:12849:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1782607726.373313:0:12849:0:(genops.c:906:class_export_put()) final put ffff974581505800/lustre-MDT0000_UUID 00000020:00000080:3.0:1782607726.373315:0:12849:0:(genops.c:865:class_export_destroy()) destroying export ffff974581505800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1782607726.373321:0:12849:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1782607726.373347:0:12849:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1782607726.373350:0:12849:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1782607726.373353:0:12849:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1782607726.373355:0:12849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782607726.373358:0:12849:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1782607726.373364:0:12849:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff974542c04000 fae11c6e-4506-4104-bb8c-df42498f7e08 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1782607726.373369:0:12849:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff974549e6b380) has exports, disconnecting them 00000020:00080000:3.0:1782607726.373373:0:12849:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff974542c04000), last request at 1782607489 00000020:00000080:3.0:1782607726.373386:0:12849:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8109266df35cae2a 00000020:00010000:3.0:1782607726.373389:0:12849:0:(genops.c:1942:obd_stale_export_put()) Put export ffff974542c04000: total 2 00000100:00080000:3.0:1782607726.373392:0:12849:0:(import.c:65:import_set_state_nolock()) ffff974542c02800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1782607726.373466:0:12849:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff974542c04000): rc 0 00000020:00080000:3.0:1782607726.373470:0:12849:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff974549e6b380) has no exports 00000100:00100000:1.0:1782607726.373582:0:5797:0:(service.c:3182:ptlrpc_main()) ll_mgs_0001: service thread [ffff974550980400:5797] 1 exiting: rc = 0 00000020:00000080:1.0:1782607726.373662:0:12572:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97456fc9b000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1782607726.373667:0:12572:0:(genops.c:906:class_export_put()) final put ffff97457fa01800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1782607726.373670:0:12572:0:(genops.c:865:class_export_destroy()) destroying export ffff97457fa01800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1782607726.373673:0:12572:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1782607726.373746:0:12572:0:(genops.c:865:class_export_destroy()) destroying export ffff974581502000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1782607726.373749:0:12572:0:(genops.c:906:class_export_put()) final put ffff974581505000/lustre-MDD0000_UUID 00000020:00000080:1.0:1782607726.373751:0:12572:0:(genops.c:865:class_export_destroy()) destroying export ffff974581505000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1782607726.373754:0:12572:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1782607726.373935:0:12572:0:(genops.c:865:class_export_destroy()) destroying export ffff974581503000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:2.0:1782607726.374128:0:5791:0:(genops.c:1928:obd_stale_export_get()) Get export ffff974542c04000: total 0 00010000:00010000:2.0:1782607726.374157:0:5791:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff974542c04000, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1782607726.374183:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97455d648000/0x8109266df35cb12c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8109266df35cb125 expref: 9 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607726.374200:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9745585ac400/0x8109266df35cb13a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8109266df35cb133 expref: 8 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607726.374209:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974540031400/0x8109266df35cb148 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8109266df35cb141 expref: 7 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607726.374232:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9745585ad200/0x8109266df35cb156 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8109266df35cb14f expref: 6 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607726.374243:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97455d648a00/0x8109266df35cb37f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8109266df35cb378 expref: 5 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607726.374253:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97457f467400/0x8109266df35cb38d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8109266df35cb386 expref: 4 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607726.374270:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9745821d0e00/0x8109266df35caf42 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8109266df35caf3b expref: 3 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607726.374283:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9745585ac200/0x8109266df35cb180 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8109266df35cb179 expref: 2 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607726.374294:0:5791:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff974542c04000, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1782607726.374306:0:5791:0:(genops.c:906:class_export_put()) final put ffff974542c04000/fae11c6e-4506-4104-bb8c-df42498f7e08 00010000:00010000:2.0:1782607726.374356:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607726.374358:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607726.374360:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782607726.374395:0:5795:0:(service.c:3182:ptlrpc_main()) ll_mgs_0000: service thread [ffff9745489d0000:5795] 0 exiting: rc = 1 00000100:00100000:0.0:1782607726.374505:0:5798:0:(service.c:3182:ptlrpc_main()) ll_mgs_0002: service thread [ffff974550881a00:5798] 2 exiting: rc = 0 00000100:00100000:3.0:1782607726.374690:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.374698:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.374705:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.374711:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.374729:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.374736:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.374741:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.374747:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.374752:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.374759:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.374791:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.374797:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.374803:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.374809:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.374815:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.374821:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.374835:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.374842:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.374847:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.374947:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.374955:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.374961:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.374967:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.374972:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.374977:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.374983:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.374989:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.374996:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.375002:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.375007:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.375012:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.375018:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.375023:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.375040:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.375046:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.375053:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.375059:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.375065:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.375071:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.375077:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.375083:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.375088:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.375094:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.375099:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.375105:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.375110:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.375116:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.375122:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.375128:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.375134:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.375140:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.375153:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.375158:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.375164:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.375170:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.375176:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.375182:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.375187:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.375194:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.375200:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.375206:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.375211:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.375216:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.375221:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1782607726.375587:0:12849:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1782607726.375590:0:12849:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:1.0:1782607726.376488:0:12572:0:(genops.c:865:class_export_destroy()) destroying export ffff974542c04000/fae11c6e-4506-4104-bb8c-df42498f7e08 for MGS 00000020:00000080:1.0:1782607726.376534:0:12572:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff974542c02800 for MGS 00000020:01000000:3.0:1782607726.377549:0:12849:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97444379e060 - data ffff974566a176c0/ffff974580da5c00 00000020:01000000:3.0:1782607726.377738:0:12849:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9745509a3120 - data ffff97455efd8e58/ffff974550445000 00000020:00000080:3.0:1782607726.378336:0:12849:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8109266df35cae0e 00000020:00000080:3.0:1782607726.378344:0:12849:0:(genops.c:906:class_export_put()) final put ffff97455130b800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1782607726.378398:0:12849:0:(tgt_mount.c:187:server_put_mount()) put mount ffff974544151000 from MGS, refs=2 00000020:01000004:3.0:1782607726.378402:0:12849:0:(obd_mount.c:701:lustre_put_lsi()) put ffff974544151000 2 00000020:01000004:3.0:1782607726.378405:0:12849:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff974544151000 from MGS 00000020:00000080:3.0:1782607726.378424:0:12849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782607726.378430:0:12849:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1782607726.378432:0:12849:0:(genops.c:906:class_export_put()) final put ffff97455130e800/MGS 00000020:00000080:3.0:1782607726.378435:0:12849:0:(genops.c:865:class_export_destroy()) destroying export ffff97455130e800/MGS for MGS 00000020:01000000:3.0:1782607726.378442:0:12849:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1782607726.378487:0:12849:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1782607726.378491:0:12849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782607726.378495:0:12849:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1782607726.378501:0:12849:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff974551165000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1782607726.378507:0:12849:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff97454431b380) has exports, disconnecting them 00000020:00080000:3.0:1782607726.378511:0:12849:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff974551165000), last request at 1782607490 00000020:00000080:3.0:1782607726.378524:0:12849:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8109266df35caed9 00000020:00080000:3.0:1782607726.378533:0:12849:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff974551165000): rc 0 00000020:00000080:3.0:1782607726.378537:0:12849:0:(genops.c:906:class_export_put()) final put ffff974551165000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1782607726.378561:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97455130b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1782607726.379675:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff974551165000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1782607726.387850:0:12849:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1782607726.387860:0:12849:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1782607726.387864:0:12849:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1782607726.387872:0:12849:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1782607726.387970:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff974551162800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1782607726.388184:0:12849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782607726.388206:0:12849:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1782607726.388238:0:12849:0:(genops.c:906:class_export_put()) final put ffff97457994e000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1782607726.388243:0:12849:0:(genops.c:865:class_export_destroy()) destroying export ffff97457994e000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1782607726.388250:0:12849:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1782607726.388314:0:12849:0:(obd_mount.c:701:lustre_put_lsi()) put ffff974544151000 1 00000020:00000080:2.0:1782607726.388321:0:12849:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8109266df35cae00 00000020:00000080:2.0:1782607726.388328:0:12849:0:(genops.c:906:class_export_put()) final put ffff974551309800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1782607726.388343:0:12849:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1782607726.388349:0:12849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782607726.388354:0:12849:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1782607726.388358:0:12849:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff97454431cd40) has no exports 00000020:00000080:1.0:1782607726.388395:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff974551309800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1782607726.446624:0:12849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782607726.446639:0:12849:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1782607726.446645:0:12849:0:(genops.c:906:class_export_put()) final put ffff974544150000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1782607726.446650:0:12849:0:(genops.c:865:class_export_destroy()) destroying export ffff974544150000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1782607726.446662:0:12849:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1782607726.446820:0:12849:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff974544157000 00000020:01000000:2.0:1782607726.446839:0:12849:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1782607726.446842:0:12849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782607726.446847:0:12849:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1782607726.446850:0:12849:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff974549e6cd40) has no exports 00000100:00100000:2.0:1782607726.446921:0:5804:0:(service.c:3182:ptlrpc_main()) mdt00_001: service thread [ffff974545239400:5804] 1 exiting: rc = 0 00000100:00100000:1.0:1782607726.447861:0:5803:0:(service.c:3182:ptlrpc_main()) mdt00_000: service thread [ffff97455088fc00:5803] 0 exiting: rc = 1 00000100:00100000:1.0:1782607726.447922:0:5805:0:(service.c:3182:ptlrpc_main()) mdt00_002: service thread [ffff974545238600:5805] 2 exiting: rc = 0 00000100:00100000:1.0:1782607726.452903:0:7437:0:(service.c:3182:ptlrpc_main()) mdt00_003: service thread [ffff97456724de00:7437] 3 exiting: rc = 0 00000100:00100000:2.0:1782607726.453268:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453276:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453282:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453288:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453293:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453299:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453305:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453312:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453317:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453323:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453348:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453354:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453360:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453365:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453370:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453377:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453382:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453388:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453393:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453398:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453403:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453408:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453413:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453419:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453424:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453430:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453435:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453440:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453446:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453451:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453456:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453462:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453467:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453472:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453477:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453483:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453488:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453494:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453499:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453505:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453510:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453515:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453521:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453527:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453534:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453546:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453552:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453558:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453564:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453569:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453575:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453581:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453587:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453592:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453611:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453618:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453625:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453632:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453640:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453646:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453651:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453657:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453662:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.453667:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.456832:0:5806:0:(service.c:3182:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff97455d457400:5806] 0 exiting: rc = 1 00000100:00100000:1.0:1782607726.456929:0:5807:0:(service.c:3182:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9745508a3800:5807] 1 exiting: rc = 0 00000100:00100000:2.0:1782607726.463666:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463676:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463681:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463687:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463693:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463698:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463703:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463709:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463714:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463732:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463738:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463744:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463750:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463755:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463759:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463783:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463801:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463805:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463810:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463815:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463819:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463824:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463830:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463835:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463840:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463846:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463851:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463855:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463860:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463865:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463870:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463875:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463880:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463885:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463890:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463895:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463900:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463905:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463910:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463915:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463919:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463924:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463929:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463934:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463938:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463943:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463948:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463953:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463958:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463962:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463967:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463979:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463984:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463988:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463993:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.463998:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.464003:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.464008:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.464014:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.464018:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.464024:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.464029:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.464034:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.464039:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.464476:0:12340:0:(service.c:3182:ptlrpc_main()) mdt_out00_002: service thread [ffff9745442ea600:12340] 2 exiting: rc = 0 00000100:00100000:3.0:1782607726.465115:0:5809:0:(service.c:3182:ptlrpc_main()) mdt_out00_001: service thread [ffff9745489d1200:5809] 1 exiting: rc = 0 00000100:00100000:1.0:1782607726.465243:0:5808:0:(service.c:3182:ptlrpc_main()) mdt_out00_000: service thread [ffff9745489d0400:5808] 0 exiting: rc = 1 00000100:00100000:2.0:1782607726.465325:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.465332:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.465359:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.465366:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.465373:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.465380:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.465386:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.465391:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.465398:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.465405:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.465412:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.465430:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.465436:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.465443:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.465465:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.465472:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.465478:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.465484:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.465489:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.465495:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.465500:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.465518:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.465524:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.465530:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.465537:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.465543:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.465562:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.465569:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.465574:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.468373:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.468407:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.468431:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.468439:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.468446:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.468452:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.468458:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.468465:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.468473:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.468481:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.468487:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.468495:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.468518:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.468525:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.468531:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.468537:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.468543:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.468550:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.468556:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.468562:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.468569:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.468574:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.469003:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.469015:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.469038:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.469045:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.469053:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.469072:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.469079:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.469086:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.469093:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.469099:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.469105:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.469111:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.469132:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.484034:0:5811:0:(service.c:3182:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9745489d1800:5811] 1 exiting: rc = 0 00000100:00100000:2.0:1782607726.484225:0:5810:0:(service.c:3182:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9745489d0c00:5810] 0 exiting: rc = 1 00000100:00100000:3.0:1782607726.484313:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484320:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484327:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484332:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484337:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484341:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484346:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484350:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484355:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484360:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484365:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484370:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484376:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484381:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484386:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484391:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484396:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484401:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484407:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484412:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484416:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484421:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484425:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484430:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484434:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484440:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484445:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484449:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484454:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484458:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484476:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484481:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484486:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484491:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484495:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484500:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484504:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484509:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484513:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484519:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484524:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484529:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484535:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484540:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484545:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484550:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484555:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484560:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484565:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484570:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484577:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484581:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484586:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484590:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484594:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484608:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484613:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484617:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484623:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484627:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484632:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484636:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484641:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.484645:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.485114:0:5812:0:(service.c:3182:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9745489d1000:5812] 0 exiting: rc = 1 00000100:00100000:2.0:1782607726.485231:0:5813:0:(service.c:3182:ptlrpc_main()) mdt_seqm_0001: service thread [ffff974549f72000:5813] 1 exiting: rc = 0 00000100:00100000:3.0:1782607726.486108:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486128:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486133:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486138:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486143:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486148:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486153:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486158:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486164:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486169:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486175:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486180:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486185:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486190:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486195:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486200:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486205:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486210:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486215:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486220:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486225:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486230:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486235:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486241:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486246:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486252:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486258:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486263:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486268:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486273:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486278:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486282:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486287:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486292:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486298:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486303:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486315:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486320:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486324:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486329:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486335:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486340:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486346:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486351:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486356:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486362:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486367:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486371:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486375:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486381:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486386:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486391:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486397:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486401:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486406:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486411:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486416:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486421:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486426:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486432:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486437:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486441:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486446:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.486450:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607726.487297:0:5814:0:(service.c:3182:ptlrpc_main()) mdt_fld_0000: service thread [ffff9745505f5400:5814] 0 exiting: rc = 1 00000100:00100000:1.0:1782607726.487425:0:5815:0:(service.c:3182:ptlrpc_main()) mdt_fld_0001: service thread [ffff9745505f4600:5815] 1 exiting: rc = 0 00000100:00100000:3.0:1782607726.487511:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487517:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487523:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487528:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487533:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487539:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487543:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487558:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487564:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487569:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487574:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487579:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487584:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487590:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487595:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487613:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487618:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487624:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487629:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487633:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487638:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487643:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487648:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487653:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487657:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487662:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487667:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487672:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487677:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487682:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487686:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487691:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487695:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487699:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487703:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487708:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487713:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487728:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487733:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487738:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487742:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487747:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487759:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487793:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487800:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487804:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487809:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487814:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487819:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487825:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487831:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487836:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487841:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487845:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487850:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487855:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487859:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487863:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487868:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487872:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487877:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487881:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487885:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.487890:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607726.488360:0:5818:0:(service.c:3182:ptlrpc_main()) mdt_io00_002: service thread [ffff974550877a00:5818] 2 exiting: rc = 0 00000100:00100000:1.0:1782607726.488693:0:5817:0:(service.c:3182:ptlrpc_main()) mdt_io00_001: service thread [ffff974545610000:5817] 1 exiting: rc = 0 00000100:00100000:2.0:1782607726.488984:0:5816:0:(service.c:3182:ptlrpc_main()) mdt_io00_000: service thread [ffff974550877c00:5816] 0 exiting: rc = 1 00000100:00100000:1.0:1782607726.489072:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489079:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489084:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489090:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489095:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489101:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489107:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489112:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489118:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489124:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489130:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489135:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489140:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489146:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489159:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489166:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489172:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489177:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489183:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489188:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489204:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489210:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489215:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489220:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489225:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489231:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489236:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489242:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489247:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489253:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489258:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489264:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489269:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489274:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489279:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489284:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489290:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489295:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489314:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489320:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489327:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489332:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489338:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489344:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489351:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489357:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489363:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489368:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489373:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489379:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489385:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489390:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489396:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489402:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489407:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489420:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489425:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489430:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489436:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489441:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489447:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489453:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489459:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607726.489464:0:12849:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1782607726.494109:0:12849:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782607726.494123:0:12849:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1782607726.494128:0:12849:0:(genops.c:906:class_export_put()) final put ffff974543975000/MDS_uuid 00000020:00000080:1.0:1782607726.494133:0:12849:0:(genops.c:865:class_export_destroy()) destroying export ffff974543975000/MDS_uuid for MDS 00000020:01000000:1.0:1782607726.494138:0:12849:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1782607726.494273:0:12849:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1782607726.852798:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1782607727.202074:0:7525:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1782607727.202082:0:7525:0:(genops.c:906:class_export_put()) final put ffff974580e4c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1782607727.202110:0:12572:0:(genops.c:865:class_export_destroy()) destroying export ffff974580e4c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1782607727.202164:0:12572:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff974580e4e800 for lustre-OST0001 00010000:00010000:0.0:1782607727.876595:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607728.897966:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1782607729.050579:0:13006:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1782607729.068652:0:13006:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1782607729.068712:0:13006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9745585ac800/0x8109266df35cb141 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb148 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607729.068728:0:13006:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9745585ac800/0x8109266df35cb141 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cb148 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607729.068737:0:13006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9745585ac800/0x8109266df35cb141 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x8109266df35cb148 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607729.068762:0:13006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff9745585ac800/0x8109266df35cb141 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x8109266df35cb148 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607729.068962:0:13006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1782607729.068968:0:13006:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1782607729.068990:0:13006:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1782607729.068994:0:13006:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1782607729.069000:0:13006:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1782607729.069006:0:13006:0:(import.c:65:import_set_state_nolock()) ffff974577167800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1782607729.069010:0:13006:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1782607729.069012:0:13006:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1782607729.069015:0:13006:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1782607729.069829:0:7513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782607729.069840:0:7513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff9745585ac800/0x8109266df35cb141 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x8109266df35cb148 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607729.069850:0:7513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ac800 already unused, calling callback (ffffffffc1db0c20) 10000000:00010000:0.0:1782607729.069854:0:7513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff9745585ac800/0x8109266df35cb141 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x8109266df35cb148 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607729.069864:0:7513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff9745585ac800/0x8109266df35cb141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x8109266df35cb148 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782607729.069871:0:7513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff9745585ac800/0x8109266df35cb141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x8109266df35cb148 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782607729.069891:0:7513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1782607729.069894:0:7513:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1782607729.069897:0:7513:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1782607729.069940:0:7513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff9745585ac800/0x8109266df35cb141 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x8109266df35cb148 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607729.069947:0:13006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974540030800/0x8109266df35cb14f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb156 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607729.069947:0:7513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782607729.069959:0:13006:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974540030800/0x8109266df35cb14f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cb156 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607729.069967:0:13006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974540030800/0x8109266df35cb14f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x8109266df35cb156 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607729.069974:0:13006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff974540030800/0x8109266df35cb14f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x8109266df35cb156 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607729.069982:0:7513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff9745585ac800/0x8109266df35cb141 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8109266df35cb148 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607729.069990:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff9745585ac800/0x8109266df35cb141 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x8109266df35cb148 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607729.069992:0:13006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782607729.070003:0:13006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97455d648600/0x8109266df35cb386 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb38d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607729.070009:0:7513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782607729.070014:0:7513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974540030800/0x8109266df35cb14f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x8109266df35cb156 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607729.070031:0:7513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974540030800 already unused, calling callback (ffffffffc1db0c20) 10000000:00010000:0.0:1782607729.070035:0:7513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974540030800/0x8109266df35cb14f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x8109266df35cb156 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607729.070036:0:13006:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97455d648600/0x8109266df35cb386 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cb38d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607729.070050:0:7513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974540030800/0x8109266df35cb14f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x8109266df35cb156 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607729.070052:0:13006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97455d648600/0x8109266df35cb386 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8109266df35cb38d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782607729.070065:0:7513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974540030800/0x8109266df35cb14f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x8109266df35cb156 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607729.070068:0:13006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff97455d648600/0x8109266df35cb386 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8109266df35cb38d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782607729.070082:0:7513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1782607729.070085:0:7513:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1782607729.070096:0:7513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974540030800/0x8109266df35cb14f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x8109266df35cb156 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607729.070108:0:7513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782607729.070129:0:7513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974540030800/0x8109266df35cb14f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x8109266df35cb156 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607729.070130:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1782607729.070141:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974540030800/0x8109266df35cb14f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x8109266df35cb156 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607729.070152:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782607729.070153:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974549e7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fae11c6e-4506-4104-bb8c-df42498f7e08:3318:1869199364414720:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782607729.070155:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607729.070159:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607729.070168:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782607729.070174:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782607729.070187:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974549e7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fae11c6e-4506-4104-bb8c-df42498f7e08:3317:1869199364414848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782607729.070224:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607729.070306:0:5789:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364414720 00000100:00100000:2.0:1782607729.070313:0:5789:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364414720 00000100:00100000:2.0:1782607729.070355:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782607729.070364:0:5789:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974577609f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3318:x1869199364414720:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1782607729.070371:0:5789:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782607729 with bad export cookie 9298005159359327786 00010000:00010000:3.0:1782607729.073785:0:13006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1782607729.073795:0:13006:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:3.0:1782607729.073802:0:13006:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:0.0:1782607729.073829:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:01000004:3.0:1782607729.073835:0:13006:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00010000:00010000:0.0:1782607729.073840:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff97455d648600/0x8109266df35cb386 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8109266df35cb38d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:3.0:1782607729.073841:0:13006:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1782607729.073850:0:13006:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00010000:00010000:0.0:1782607729.073853:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d648600 already unused, calling callback (ffffffffc1db0c20) 00000020:00000080:3.0:1782607729.073857:0:13006:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 10000000:00010000:0.0:1782607729.073859:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff97455d648600/0x8109266df35cb386 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8109266df35cb38d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1782607729.073862:0:13006:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff97457f5fcd40) has no exports 00010000:00010000:0.0:1782607729.073874:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff97455d648600/0x8109266df35cb386 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x8109266df35cb38d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782607729.073883:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff97455d648600/0x8109266df35cb386 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x8109266df35cb38d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782607729.073888:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1782607729.073890:0:5791:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1782607729.073907:0:5791:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000020:00080000:3.0:1782607729.073908:0:13006:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff97457f5fcd40) has no exports 00010000:00010000:0.0:1782607729.073946:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff97455d648600/0x8109266df35cb386 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x8109266df35cb38d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607729.073953:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782607729.073973:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff97455d648600/0x8109266df35cb386 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x8109266df35cb38d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607729.073980:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff97455d648600/0x8109266df35cb386 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x8109266df35cb38d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607729.073994:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607729.073996:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607729.073998:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607729.074677:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782607729.074712:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974549e7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fae11c6e-4506-4104-bb8c-df42498f7e08:3316:1869199364414976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782607729.074810:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607729.075105:0:5788:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1782607729.075116:0:5788:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1782607729.075414:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364414976 00000100:00100000:1.0:1782607729.075422:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364414976 00000100:00100000:0.0:1782607729.075568:0:13007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782607729.075667:0:13007:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f40f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3316:x1869199364414976:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1782607729.075674:0:13007:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782607729 with bad export cookie 9298005159359327786 00000100:00100000:0.0:1782607729.075839:0:13007:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f40f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3316:x1869199364414976:12345-0@lo:103:ldlm_bl.0 Request processed in 173us (1028us total) trans 0 rc -107/-107 00000100:00100000:0.0:1782607729.075848:0:13007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000020:01000000:3.0:1782607729.080560:0:13006:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff974550415f60 - data ffff97457fc31360/ffff97457f4f1c00 00000020:01000000:3.0:1782607729.080970:0:13006:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff974546c8dae0 - data ffff974571bd3a20/ffff974547699800 00000100:00080000:1.0:1782607729.081345:0:3316:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.104@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1782607729.081352:0:3316:0:(import.c:65:import_set_state_nolock()) ffff974543974000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1782607729.081357:0:3316:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.104@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:3.0:1782607729.081873:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607729.081982:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364414848 00000100:00100000:0.0:1782607729.081990:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364414848 00000100:00100000:0.0:1782607729.082041:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782607729.082050:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443369500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3317:x1869199364414848:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1782607729.082058:0:5788:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782607729 with bad export cookie 9298005159359327786 00000100:00100000:0.0:1782607729.082122:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443369500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3317:x1869199364414848:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (251us total) trans 0 rc -107/-107 00000100:00100000:0.0:1782607729.082129:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1782607729.082200:0:3317:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.104@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:2.0:1782607729.084040:0:5789:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974577609f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3318:x1869199364414720:12345-0@lo:103:ldlm_bl.0 Request processed in 13671us (13811us total) trans 0 rc -107/-107 00000100:00100000:2.0:1782607729.084053:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1782607729.084091:0:3318:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.104@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1782607729.090383:0:3316:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.104@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1782607729.090389:0:3316:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1782607729.090400:0:3316:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff974549e7f100 x1869199364414720/t0(0) o103->MGC192.168.202.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1782607745 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607729.090416:0:3316:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff974549e7e300 x1869199364414848/t0(0) o103->MGC192.168.202.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1782607745 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607729.090449:0:3316:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff974549e7dc00 x1869199364414976/t0(0) o103->MGC192.168.202.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1782607745 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1782607729.090457:0:3316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1782607729.090460:0:3316:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1782607729.090461:0:3316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1782607729.090506:0:3317:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff974543974000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1782607729.090531:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974549e7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fae11c6e-4506-4104-bb8c-df42498f7e08:3317:1869199364414848:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1782607729.090732:0:3318:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff974543974000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1782607729.090744:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974549e7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fae11c6e-4506-4104-bb8c-df42498f7e08:3318:1869199364414720:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1782607729.090981:0:3316:0:(import.c:65:import_set_state_nolock()) ffff974543974000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782607729.090987:0:3316:0:(import.c:512:import_select_connection()) MGC192.168.202.104@tcp: connect to NID 0@lo last attempt 148 00000100:00080000:1.0:1782607729.090994:0:3316:0:(import.c:626:import_select_connection()) MGC192.168.202.104@tcp: import ffff974543974000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1782607729.091106:0:3316:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97457f40d500 x1869199364415104/t0(0) o250->MGC192.168.202.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782607729.091137:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974549e7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fae11c6e-4506-4104-bb8c-df42498f7e08:3316:1869199364414976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782607729.091187:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fae11c6e-4506-4104-bb8c-df42498f7e08:3315:1869199364415104:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:2.0:1782607729.091234:0:3315:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869199364415104 offset 0 length 520: 4 00100000:10000000:2.0:1782607729.109487:0:13006:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1782607729.134299:0:13006:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8109266df35caf5e 00000020:00000080:3.0:1782607729.134309:0:13006:0:(genops.c:906:class_export_put()) final put ffff97457993b800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1782607729.134333:0:13006:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97455053f000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1782607729.134337:0:13006:0:(obd_mount.c:701:lustre_put_lsi()) put ffff97455053f000 2 00000020:01000004:3.0:1782607729.134350:0:13006:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97455053f000 from lustre-OST0000 00000020:00000080:3.0:1782607729.134374:0:13006:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782607729.134456:0:12572:0:(genops.c:865:class_export_destroy()) destroying export ffff97457993b800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1782607729.134485:0:13006:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1782607729.134489:0:13006:0:(genops.c:906:class_export_put()) final put ffff9745809cb000/lustre-OST0000_UUID 00000020:00000080:3.0:1782607729.134492:0:13006:0:(genops.c:865:class_export_destroy()) destroying export ffff9745809cb000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1782607729.134498:0:13006:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1782607729.134536:0:13006:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1782607729.134540:0:13006:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1782607729.134544:0:13006:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782607729.134548:0:13006:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1782607729.134555:0:13006:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff97457f5e2800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1782607729.134560:0:13006:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff9745810c99c0) has exports, disconnecting them 00000020:00080000:3.0:1782607729.134565:0:13006:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff97457f5e2800), last request at 1782607506 00000020:00000080:3.0:1782607729.134569:0:13006:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8109266df35caf88 00000020:00080000:3.0:1782607729.134629:0:13006:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97457f5e2800): rc 0 00000020:00000080:3.0:1782607729.134635:0:13006:0:(genops.c:906:class_export_put()) final put ffff97457f5e2800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1782607729.135885:0:12572:0:(genops.c:865:class_export_destroy()) destroying export ffff97457f5e2800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1782607729.136831:0:13006:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1782607729.136838:0:13006:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1782607729.136843:0:13006:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1782607729.136850:0:13006:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1782607729.136988:0:13006:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782607729.136997:0:13006:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1782607729.137003:0:13006:0:(obd_mount.c:701:lustre_put_lsi()) put ffff97455053f000 1 00000020:00000080:0.0:1782607729.137010:0:13006:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8109266df35caf18 00000020:00000080:0.0:1782607729.137018:0:13006:0:(genops.c:906:class_export_put()) final put ffff974547773000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1782607729.137027:0:13006:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1782607729.137032:0:13006:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782607729.137037:0:13006:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1782607729.137040:0:13006:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9745810ccd40) has no exports 00000020:00000080:1.0:1782607729.137655:0:12572:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff974577167800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1782607729.137664:0:12572:0:(genops.c:906:class_export_put()) final put ffff97457f5e3000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1782607729.137666:0:12572:0:(genops.c:865:class_export_destroy()) destroying export ffff97457f5e3000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1782607729.137674:0:12572:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1782607729.137743:0:12572:0:(genops.c:865:class_export_destroy()) destroying export ffff974547773000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1782607729.147197:0:13006:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782607729.147215:0:13006:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1782607729.147221:0:13006:0:(genops.c:906:class_export_put()) final put ffff97455053d000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1782607729.147227:0:13006:0:(genops.c:865:class_export_destroy()) destroying export ffff97455053d000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1782607729.147234:0:13006:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1782607729.147369:0:13006:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff974550538000 00000020:02000400:0.0:1782607729.149494:0:13006:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1782607729.923225:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607730.946727:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782607731.266360:0:12572:0:(pinger.c:231:ptlrpc_pinger_process_import()) fae11c6e-4506-4104-bb8c-df42498f7e08->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1782607731.266369:0:12572:0:(pinger.c:249:ptlrpc_pinger_process_import()) fae11c6e-4506-4104-bb8c-df42498f7e08->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1782607731.266372:0:12572:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1782607731.266375:0:12572:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1782607731.266379:0:12572:0:(import.c:65:import_set_state_nolock()) ffff974550539000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782607731.266397:0:12572:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 385 00000100:00080000:0.0:1782607731.266403:0:12572:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1782607731.266410:0:12572:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff974550539000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1782607731.266441:0:12572:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff974549e7df80 x1869199364415232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782607731.266697:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974549e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3315:1869199364415232:0@lo:38:kworker.0 00000400:00000100:2.0:1782607731.266747:0:3315:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869199364415232 offset 0 length 520: 4 00010000:00010000:0.0:1782607731.976230:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1782607732.068090:0:13156:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1782607732.086684:0:13156:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1782607732.086805:0:13156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9745821d1e00/0x8109266df35cb125 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb12c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607732.086820:0:13156:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9745821d1e00/0x8109266df35cb125 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cb12c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607732.086827:0:13156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9745821d1e00/0x8109266df35cb125 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8109266df35cb12c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607732.086834:0:13156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff9745821d1e00/0x8109266df35cb125 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8109266df35cb12c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607732.087368:0:13156:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1782607732.087375:0:13156:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1782607732.087402:0:13156:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1782607732.087414:0:13156:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff974549e7df80 x1869199364415232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1782607746 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607732.087444:0:13156:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1782607732.087450:0:13156:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1782607732.087457:0:13156:0:(import.c:65:import_set_state_nolock()) ffff974550539000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1782607732.087463:0:13156:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1782607732.087467:0:13156:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff974549e7df80 x1869199364415232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1782607746 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607732.087475:0:13156:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1782607732.087478:0:13156:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00000100:00100000:2.0:1782607732.088798:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974549e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3315:1869199364415232:0@lo:38:kworker.0 00010000:00010000:1.0:1782607732.090209:0:13156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974540031200/0x8109266df35cb133 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb13a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607732.090224:0:13156:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974540031200/0x8109266df35cb133 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cb13a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607732.090232:0:13156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974540031200/0x8109266df35cb133 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8109266df35cb13a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607732.090238:0:13156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff974540031200/0x8109266df35cb133 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8109266df35cb13a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607732.090873:0:7513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782607732.090883:0:7513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff9745821d1e00/0x8109266df35cb125 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8109266df35cb12c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607732.090891:0:7513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745821d1e00 already unused, calling callback (ffffffffc1db0c20) 10000000:00010000:0.0:1782607732.090895:0:7513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff9745821d1e00/0x8109266df35cb125 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8109266df35cb12c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607732.090904:0:7513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff9745821d1e00/0x8109266df35cb125 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8109266df35cb12c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782607732.090912:0:7513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff9745821d1e00/0x8109266df35cb125 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8109266df35cb12c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782607732.090918:0:7513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1782607732.090921:0:7513:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1782607732.090924:0:7513:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1782607732.090939:0:7513:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff974543974000 00010000:00010000:0.0:1782607732.090943:0:7513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff9745821d1e00/0x8109266df35cb125 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8109266df35cb12c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607732.090949:0:7513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff9745821d1e00/0x8109266df35cb125 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8109266df35cb12c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607732.090983:0:7513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782607732.090986:0:7513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974540031200/0x8109266df35cb133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8109266df35cb13a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607732.090992:0:7513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974540031200 already unused, calling callback (ffffffffc1db0c20) 10000000:00010000:0.0:1782607732.090995:0:7513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974540031200/0x8109266df35cb133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8109266df35cb13a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607732.091000:0:7513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974540031200/0x8109266df35cb133 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x8109266df35cb13a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782607732.091007:0:7513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974540031200/0x8109266df35cb133 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x8109266df35cb13a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782607732.091011:0:7513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1782607732.091013:0:7513:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:0.0:1782607732.091017:0:7513:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff974543974000 00010000:00010000:0.0:1782607732.091019:0:7513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974540031200/0x8109266df35cb133 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8109266df35cb13a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607732.091024:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607732.091026:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607732.091027:0:7513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607732.091174:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607732.091195:0:13156:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1782607732.091201:0:13156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974540031200/0x8109266df35cb133 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8109266df35cb13a expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607732.091221:0:13156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974546c43000/0x8109266df35cb378 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cb37f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607732.091228:0:13156:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974546c43000/0x8109266df35cb378 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cb37f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607732.091234:0:13156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974546c43000/0x8109266df35cb378 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8109266df35cb37f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607732.091241:0:13156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff974546c43000/0x8109266df35cb378 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8109266df35cb37f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607732.091277:0:13156:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1782607732.091282:0:13156:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:1.0:1782607732.091285:0:13156:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1782607732.091311:0:13156:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1782607732.091315:0:13156:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1782607732.091320:0:13156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782607732.091325:0:13156:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1782607732.091329:0:13156:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff974581508000) has no exports 00000020:00080000:1.0:1782607732.091352:0:13156:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff974581508000) has no exports 00000020:01000000:1.0:1782607732.093093:0:13156:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9745504156c0 - data ffff97457fc31bd0/ffff97457f4f0800 00000020:01000000:1.0:1782607732.093270:0:13156:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97444379e480 - data ffff97457fc41e58/ffff97457f48d800 00010000:00010000:0.0:1782607732.095638:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782607732.095652:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974546c43000/0x8109266df35cb378 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8109266df35cb37f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607732.095664:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c43000 already unused, calling callback (ffffffffc1db0c20) 10000000:00010000:0.0:1782607732.095696:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974546c43000/0x8109266df35cb378 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8109266df35cb37f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607732.095708:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974546c43000/0x8109266df35cb378 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8109266df35cb37f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782607732.095716:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974546c43000/0x8109266df35cb378 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8109266df35cb37f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782607732.095721:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1782607732.095724:0:5791:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1782607732.095728:0:5791:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1782607732.095748:0:5791:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff974543974000 00010000:00010000:0.0:1782607732.095752:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974546c43000/0x8109266df35cb378 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x8109266df35cb37f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607732.095758:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974546c43000/0x8109266df35cb378 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x8109266df35cb37f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607732.095836:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607732.095837:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607732.095840:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1782607732.112650:0:13156:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1782607732.143694:0:13156:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8109266df35cb029 00000020:00000080:0.0:1782607732.143705:0:13156:0:(genops.c:906:class_export_put()) final put ffff974580e4d800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1782607732.143724:0:13156:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97457f5e0000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1782607732.143728:0:13156:0:(obd_mount.c:701:lustre_put_lsi()) put ffff97457f5e0000 2 00000020:01000004:0.0:1782607732.143731:0:13156:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97457f5e0000 from lustre-OST0001 00000020:00000080:0.0:1782607732.143753:0:13156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782607732.143762:0:13156:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1782607732.143787:0:13156:0:(genops.c:906:class_export_put()) final put ffff974580e4b000/lustre-OST0001_UUID 00000020:00000080:0.0:1782607732.143791:0:13156:0:(genops.c:865:class_export_destroy()) destroying export ffff974580e4b000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1782607732.143803:0:13156:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:2.0:1782607732.143932:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff974580e4d800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:0.0:1782607732.144037:0:13156:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import fae11c6e-4506-4104-bb8c-df42498f7e08->MGS 00010000:00010000:0.0:1782607732.144055:0:13156:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff9745585adc00/0x8109266df35caf3b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8109266df35caf42 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782607732.144068:0:13156:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff9745585adc00/0x8109266df35caf3b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8109266df35caf42 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782607732.144076:0:13156:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1782607732.144079:0:13156:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1782607732.144083:0:13156:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1782607732.144098:0:13156:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff974543974000 00010000:00010000:0.0:1782607732.144102:0:13156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff9745585adc00/0x8109266df35caf3b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8109266df35caf42 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607732.144123:0:13156:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974540030e00/0x8109266df35cb179 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8109266df35cb180 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782607732.144130:0:13156:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974540030e00/0x8109266df35cb179 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8109266df35cb180 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782607732.144135:0:13156:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1782607732.144138:0:13156:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1782607732.144139:0:13156:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1782607732.144148:0:13156:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff974543974000 00010000:00010000:0.0:1782607732.144150:0:13156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974540030e00/0x8109266df35cb179 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8109266df35cb180 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1782607732.144166:0:13156:0:(import.c:65:import_set_state_nolock()) ffff974543974000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1782607732.144169:0:13156:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1782607732.144172:0:13156:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1782607732.144173:0:13156:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1782607732.144177:0:13156:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1782607732.144195:0:13156:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff97457f40d500 x1869199364415104/t0(0) o250->MGC192.168.202.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1782607739 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1782607732.144261:0:13156:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1782607732.144264:0:13156:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:2.0:1782607732.144975:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fae11c6e-4506-4104-bb8c-df42498f7e08:3315:1869199364415104:0@lo:250:ptlrpcd_00_00.0 10000000:01000000:0.0:1782607732.145050:0:13156:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1782607732.145059:0:13156:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8109266df35cae1c 00000020:00000080:0.0:1782607732.145064:0:13156:0:(genops.c:906:class_export_put()) final put ffff974543973800/fae11c6e-4506-4104-bb8c-df42498f7e08 00000020:01000000:0.0:1782607732.145080:0:13156:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.202.104@tcp (flags='') 00000020:00000080:0.0:1782607732.145087:0:13156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782607732.145095:0:13156:0:(obd_config.c:955:class_cleanup()) MGC192.168.202.104@tcp: forcing exports to disconnect: 0/3 00000020:00000080:3.0:1782607732.145098:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff974543973800/fae11c6e-4506-4104-bb8c-df42498f7e08 for MGC192.168.202.104@tcp 00000020:00080000:0.0:1782607732.145100:0:13156:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff974549e68000) has no exports 10000000:01000000:3.0:1782607732.145322:0:5800:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1782607732.145349:0:13156:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.202.104@tcp: client import never connected 00000100:00080000:0.0:1782607732.145353:0:13156:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1782607732.145356:0:13156:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1782607732.145358:0:13156:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1782607732.145361:0:13156:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1782607732.145405:0:13156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782607732.145411:0:13156:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.104@tcp (uuid fae11c6e-4506-4104-bb8c-df42498f7e08) 00000020:01000000:0.0:1782607732.145416:0:13156:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1782607732.145419:0:13156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782607732.145423:0:13156:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1782607732.145428:0:13156:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff974577160000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1782607732.145433:0:13156:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff9745775719c0) has exports, disconnecting them 00000020:00080000:0.0:1782607732.145438:0:13156:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff974577160000), last request at 1782607526 00000020:00000080:0.0:1782607732.145442:0:13156:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8109266df35cb053 00000020:00080000:0.0:1782607732.145453:0:13156:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff974577160000): rc 0 00000020:00000080:0.0:1782607732.145457:0:13156:0:(genops.c:906:class_export_put()) final put ffff974577160000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1782607732.146332:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff974543974000 for MGC192.168.202.104@tcp 00000020:00000080:2.0:1782607732.146342:0:36:0:(genops.c:906:class_export_put()) final put ffff974543976800/fae11c6e-4506-4104-bb8c-df42498f7e08 00000020:00000080:2.0:1782607732.146344:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff974543976800/fae11c6e-4506-4104-bb8c-df42498f7e08 for MGC192.168.202.104@tcp 00000020:01000000:2.0:1782607732.146353:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.104@tcp (fae11c6e-4506-4104-bb8c-df42498f7e08) 00000020:00000080:2.0:1782607732.146593:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff974577160000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1782607732.147826:0:13156:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1782607732.147833:0:13156:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1782607732.147837:0:13156:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1782607732.147844:0:13156:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1782607732.148063:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff974550539000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1782607732.150977:0:7513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1782607732.151173:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1782607732.151277:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1782607732.151423:0:5785:0:(service.c:3182:ptlrpc_main()) ldlm_cb00_000: service thread [ffff974547ff6600:5785] 0 exiting: rc = 1 00000100:00100000:2.0:1782607732.158910:0:5786:0:(service.c:3182:ptlrpc_main()) ldlm_cb00_001: service thread [ffff974547ff7400:5786] 1 exiting: rc = 0 00000100:00100000:3.0:1782607732.160351:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782607732.160688:0:5788:0:(service.c:3182:ptlrpc_main()) ldlm_cn00_001: service thread [ffff974547ff6800:5788] 1 exiting: rc = 0 00000100:00100000:3.0:1782607732.161040:0:13007:0:(service.c:3182:ptlrpc_main()) ldlm_cn00_003: service thread [ffff974550881800:13007] 3 exiting: rc = 0 00000100:00100000:0.0:1782607732.161169:0:5787:0:(service.c:3182:ptlrpc_main()) ldlm_cn00_000: service thread [ffff974547ff7600:5787] 0 exiting: rc = 1 00000100:00100000:0.0:1782607732.161225:0:5789:0:(service.c:3182:ptlrpc_main()) ldlm_cn00_002: service thread [ffff974547ff7e00:5789] 2 exiting: rc = 0 00000100:00100000:3.0:1782607732.161303:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161308:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161312:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161316:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161321:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161324:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161329:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161333:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161337:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161342:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161357:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161361:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161365:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161369:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161373:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161377:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161384:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161389:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161394:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161399:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161404:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161410:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161415:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161420:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161426:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161432:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161438:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161443:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161448:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161453:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161458:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161463:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161468:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161473:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161478:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161484:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161489:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161496:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161501:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161504:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161508:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161511:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161514:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161518:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161523:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161536:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161541:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161546:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161551:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161567:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161573:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161577:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161580:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161583:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161587:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161591:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161594:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161597:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161600:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161603:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161606:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161608:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161611:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.161614:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1782607732.163113:0:13156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782607732.163123:0:13156:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1782607732.163129:0:13156:0:(genops.c:906:class_export_put()) final put ffff974580f25000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1782607732.163133:0:13156:0:(genops.c:865:class_export_destroy()) destroying export ffff974580f25000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1782607732.163139:0:13156:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1782607732.163180:0:13156:0:(obd_mount.c:701:lustre_put_lsi()) put ffff97457f5e0000 1 00000020:00000080:3.0:1782607732.163187:0:13156:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x8109266df35caff8 00000020:00000080:3.0:1782607732.163193:0:13156:0:(genops.c:906:class_export_put()) final put ffff974548913800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1782607732.163204:0:13156:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1782607732.163209:0:13156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782607732.163213:0:13156:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1782607732.163217:0:13156:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9745810cb380) has no exports 00000020:00000080:2.0:1782607732.163368:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff974548913800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1782607732.199125:0:13156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782607732.199146:0:13156:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1782607732.199152:0:13156:0:(genops.c:906:class_export_put()) final put ffff97457f5e7800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1782607732.199170:0:13156:0:(genops.c:865:class_export_destroy()) destroying export ffff97457f5e7800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1782607732.199185:0:13156:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1782607732.199366:0:13156:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff97457f5e2000 00000020:01000000:3.0:1782607732.199401:0:13156:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1782607732.199406:0:13156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782607732.199411:0:13156:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1782607732.199414:0:13156:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff974544318000) has no exports 00000020:00000080:3.0:1782607732.199434:0:13156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782607732.199441:0:13156:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1782607732.199443:0:13156:0:(genops.c:906:class_export_put()) final put ffff974547770800/OSS_uuid 00000020:00000080:3.0:1782607732.199445:0:13156:0:(genops.c:865:class_export_destroy()) destroying export ffff974547770800/OSS_uuid for OSS 00000020:01000000:3.0:1782607732.199449:0:13156:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1782607732.199519:0:9088:0:(service.c:3182:ptlrpc_main()) ll_ost00_003: service thread [ffff97457f5e8e00:9088] 3 exiting: rc = 0 00000100:00080000:0.0:1782607732.199634:0:5799:0:(pinger.c:550:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1782607732.199806:0:6610:0:(service.c:3182:ptlrpc_main()) ll_ost00_002: service thread [ffff974551109e00:6610] 2 exiting: rc = 0 00000100:00100000:0.0:1782607732.199870:0:6608:0:(service.c:3182:ptlrpc_main()) ll_ost00_000: service thread [ffff97457101ac00:6608] 0 exiting: rc = 1 00000100:00100000:3.0:1782607732.200106:0:6609:0:(service.c:3182:ptlrpc_main()) ll_ost00_001: service thread [ffff974544170e00:6609] 1 exiting: rc = 0 00000100:00100000:3.0:1782607732.200170:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200179:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200186:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200194:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200200:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200206:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200212:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200217:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200223:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200230:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200240:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200246:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200252:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200259:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200264:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200269:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200274:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200280:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200286:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200292:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200307:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200314:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200320:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200326:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200331:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200336:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200342:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200348:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200352:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200359:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200365:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200371:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200378:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200383:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200390:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200396:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200403:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200409:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200415:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200422:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200427:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200433:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200439:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200445:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200451:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200456:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200461:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200467:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200472:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200477:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200482:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200486:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200491:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200496:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200500:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200514:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200519:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200525:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200533:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200538:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200543:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200547:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200626:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.200636:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782607732.208340:0:6613:0:(service.c:3182:ptlrpc_main()) ll_ost_create00_001: service thread [ffff974544170400:6613] 1 exiting: rc = 0 00000100:00100000:0.0:1782607732.208470:0:6612:0:(service.c:3182:ptlrpc_main()) ll_ost_create00_000: service thread [ffff974544171e00:6612] 0 exiting: rc = 1 00000100:00100000:3.0:1782607732.208728:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.208738:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.208742:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.208747:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.208753:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.208759:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.208959:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.208967:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.208972:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.208977:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.208981:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.208986:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.208991:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.208996:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209001:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209005:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209009:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209014:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209019:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209023:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209027:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209032:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209038:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209042:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209047:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209051:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209073:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209078:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209082:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209087:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209092:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209097:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209102:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209107:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209111:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209116:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209120:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209125:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209131:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209137:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209142:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209147:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209152:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209156:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209160:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209164:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209168:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209173:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209178:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209182:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209187:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209191:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209196:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209200:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209205:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209210:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209215:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209219:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209225:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209229:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209234:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209247:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209251:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.209257:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.212545:0:6615:0:(service.c:3182:ptlrpc_main()) ll_ost_io00_001: service thread [ffff974544171200:6615] 1 exiting: rc = 0 00000100:00100000:0.0:1782607732.214212:0:6616:0:(service.c:3182:ptlrpc_main()) ll_ost_io00_002: service thread [ffff974544170a00:6616] 2 exiting: rc = 0 00000100:00100000:0.0:1782607732.214496:0:6614:0:(service.c:3182:ptlrpc_main()) ll_ost_io00_000: service thread [ffff974544170200:6614] 0 exiting: rc = 1 00000100:00100000:3.0:1782607732.215704:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.215742:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.215750:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.215756:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.215761:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.215784:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.215791:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.215796:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.215801:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.215807:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.215816:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.215833:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.215840:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.215847:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.216836:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.216845:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.216913:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.216922:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.216927:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.216933:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.216939:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.216944:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.216951:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.216956:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.216961:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.216991:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.216999:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.217005:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.217011:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.217016:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.217024:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.217047:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.217074:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.217087:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.217095:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.217101:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.217106:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.217112:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.217118:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.217123:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.217128:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.217133:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.217139:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.217145:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.217150:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.217155:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.217161:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.217166:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.217172:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.217178:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.217184:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.217188:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.217194:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.217199:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.217204:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.217210:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.217215:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.217221:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.217227:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.217232:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.217238:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.217244:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.217249:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.217262:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782607732.227080:0:6617:0:(service.c:3182:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff974544171600:6617] 0 exiting: rc = 1 00000100:00100000:1.0:1782607732.228146:0:6618:0:(service.c:3182:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff974544170000:6618] 1 exiting: rc = 0 00000100:00100000:3.0:1782607732.228321:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228330:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228351:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228356:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228360:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228365:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228379:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228386:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228392:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228397:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228401:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228406:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228412:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228417:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228421:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228427:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228432:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228437:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228442:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228447:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228452:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228457:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228462:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228467:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228472:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228477:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228482:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228486:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228491:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228496:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228501:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228505:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228509:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228514:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228519:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228525:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228529:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228541:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228546:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228561:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228567:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228573:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228578:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228583:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228589:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228594:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228599:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228604:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228609:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228614:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228620:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228626:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228630:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228635:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228640:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228646:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228651:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228656:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228662:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.228668:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.230098:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.230108:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.230114:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782607732.230119:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.239040:0:6619:0:(service.c:3182:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9745510c4200:6619] 0 exiting: rc = 1 00000100:00100000:0.0:1782607732.239938:0:6620:0:(service.c:3182:ptlrpc_main()) ll_ost_out00_001: service thread [ffff97457b2afa00:6620] 1 exiting: rc = 0 00000100:00100000:1.0:1782607732.240434:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.240453:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.240471:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.240492:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.240498:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.240504:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.240510:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.240516:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.240523:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.240530:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.240536:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.240542:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.240547:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.240566:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.240588:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.240596:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.240602:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.240608:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.240615:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.240621:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.240627:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.240632:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.240638:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.240646:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.240652:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.240658:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.240689:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.240697:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.240703:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.240709:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.240715:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.240722:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.240728:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.240740:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.240745:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.240751:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.240758:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.240781:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.240813:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.240830:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.240837:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.240845:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.241000:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.241008:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.241013:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.241018:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.241024:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.241031:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.241036:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.241041:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.241063:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.241069:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.241075:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.241080:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.241086:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.241092:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.241099:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.241105:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.241111:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.241117:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.241123:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.241129:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.241149:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782607732.241156:0:13156:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1782607732.256136:0:13156:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1782607748.949636:0:13773:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1782607756.235697:0:14186:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1782607756.235702:0:14186:0:(obd_mount.c:917:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1782607756.236090:0:14186:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9745812ef000 00000020:01000004:3.0:1782607756.236108:0:14186:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1782607756.236117:0:14186:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1782607756.236131:0:14186:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9745775719c0) 00000020:00000080:3.0:1782607756.236146:0:14186:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1782607756.248022:0:14186:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1782607756.249731:0:14186:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1782607756.250580:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:3.0:1782607756.250681:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:3.0:1782607756.250804:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:3.0:1782607756.250903:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:3.0:1782607756.251097:0:14186:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1782607756.251169:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:3.0:1782607756.254604:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:3.0:1782607756.255066:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:3.0:1782607756.260217:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 319: rc = 0 00100000:10000000:3.0:1782607756.260322:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 319: rc = 0 00100000:10000000:3.0:1782607756.261143:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 85: rc = 0 00100000:10000000:3.0:1782607756.261392:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 85: rc = 0 00100000:10000000:3.0:1782607756.261656:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 85: rc = 0 00100000:10000000:3.0:1782607756.261933:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 85: rc = 0 00100000:10000000:3.0:1782607756.262186:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 85: rc = 0 00100000:10000000:3.0:1782607756.262428:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 85: rc = 0 00100000:10000000:3.0:1782607756.262706:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 85: rc = 0 00100000:10000000:3.0:1782607756.263023:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 85: rc = 0 00100000:10000000:3.0:1782607756.263272:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 85: rc = 0 00100000:10000000:3.0:1782607756.263527:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 85: rc = 0 00100000:10000000:3.0:1782607756.263808:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 85: rc = 0 00100000:10000000:3.0:1782607756.264058:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 85: rc = 0 00100000:10000000:3.0:1782607756.264466:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 601: rc = 0 00100000:10000000:3.0:1782607756.264899:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 601: rc = 0 00100000:10000000:3.0:1782607756.265140:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 601: rc = 0 00100000:10000000:3.0:1782607756.265383:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 601: rc = 0 00100000:10000000:3.0:1782607756.265651:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 601: rc = 0 00100000:10000000:3.0:1782607756.265993:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 601: rc = 0 00100000:10000000:3.0:1782607756.266246:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 601: rc = 0 00100000:10000000:3.0:1782607756.266501:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 601: rc = 0 00100000:10000000:3.0:1782607756.266750:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 601: rc = 0 00100000:10000000:3.0:1782607756.267053:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 601: rc = 0 00100000:10000000:3.0:1782607756.267304:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 601: rc = 0 00100000:10000000:3.0:1782607756.267564:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 601: rc = 0 00100000:10000000:3.0:1782607756.268025:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 601: rc = 0 00100000:10000000:3.0:1782607756.268263:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 601: rc = 0 00100000:10000000:3.0:1782607756.268533:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 601: rc = 0 00100000:10000000:3.0:1782607756.268746:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 601: rc = 0 00100000:10000000:3.0:1782607756.269010:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 601: rc = 0 00100000:10000000:3.0:1782607756.269433:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 601: rc = 0 00100000:10000000:3.0:1782607756.269732:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 601: rc = 0 00100000:10000000:3.0:1782607756.270032:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 601: rc = 0 00100000:10000000:3.0:1782607756.270277:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 601: rc = 0 00100000:10000000:3.0:1782607756.270543:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 601: rc = 0 00100000:10000000:3.0:1782607756.270801:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 601: rc = 0 00100000:10000000:3.0:1782607756.271040:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 601: rc = 0 00100000:10000000:3.0:1782607756.271282:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 601: rc = 0 00100000:10000000:3.0:1782607756.271721:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 601: rc = 0 00100000:10000000:3.0:1782607756.272145:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 601: rc = 0 00100000:10000000:3.0:1782607756.272388:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 601: rc = 0 00100000:10000000:3.0:1782607756.272637:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 601: rc = 0 00100000:10000000:3.0:1782607756.272909:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 601: rc = 0 00100000:10000000:3.0:1782607756.273155:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 601: rc = 0 00100000:10000000:3.0:1782607756.273399:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 601: rc = 0 00100000:10000000:3.0:1782607756.273743:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 99: rc = 0 00100000:10000000:3.0:1782607756.274256:0:14186:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1782607756.274407:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 324: rc = 0 00100000:10000000:3.0:1782607756.274599:0:14186:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1782607756.274665:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 324: rc = 0 00100000:10000000:3.0:1782607756.274886:0:14186:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1782607756.274951:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 324: rc = 0 00100000:10000000:3.0:1782607756.275289:0:14186:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1782607756.275353:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 320: rc = 0 00100000:10000000:3.0:1782607756.275547:0:14186:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1782607756.275613:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 320: rc = 0 00100000:10000000:3.0:1782607756.275988:0:14186:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1782607756.276058:0:14186:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 320: rc = 0 00000020:00000080:3.0:1782607756.276336:0:14186:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1782607756.276343:0:14186:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1782607756.276353:0:14186:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8109266df35cc11d 00000020:01000004:3.0:1782607756.276361:0:14186:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1782607756.276366:0:14186:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1782607756.276371:0:14186:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9745812ef000 from MGS 00000020:01000004:3.0:1782607756.276375:0:14186:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1782607756.276385:0:14186:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff974577570000) 00000020:00000080:3.0:1782607756.276394:0:14186:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1782607756.276446:0:14186:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9745812ef000 from MGS, refs=2 00080000:01000000:3.0:1782607756.276450:0:14186:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1782607756.276456:0:14186:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8109266df35cc12b 00000100:00100000:3.0:1782607756.276559:0:14186:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1782607756.276674:0:14186:0:(service.c:3461:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1782607756.276686:0:14186:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1782607756.277107:0:14186:0:(service.c:3461:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1782607756.277113:0:14186:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1782607756.277587:0:14186:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782607756.277708:0:14186:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1782607756.277712:0:14186:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1782607756.278207:0:14186:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1782607756.278213:0:14186:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1782607756.278461:0:14186:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1782607756.278469:0:14186:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1782607756.279147:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607756.279151:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607756.279152:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607756.279399:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607756.279402:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607756.279403:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607756.279968:0:14186:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1782607756.283926:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1782607756.289485:0:14186:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1782607756.289505:0:14186:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1782607756.289508:0:14186:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1782607756.297535:0:14195:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1782607756.298027:0:14186:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1782607756.298139:0:14186:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1782607756.298671:0:14186:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1782607756.299331:0:14186:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782607756.299507:0:14186:0:(service.c:3461:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1782607756.299514:0:14186:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1782607756.300205:0:14186:0:(service.c:3461:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1782607756.300212:0:14186:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1782607756.300747:0:14186:0:(service.c:3461:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1782607756.300753:0:14186:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1782607756.301592:0:14186:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1782607756.301612:0:14186:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.202.104@tcp' 00000020:01000004:3.0:1782607756.301614:0:14186:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1782607756.301641:0:14186:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.202.104@tcp (typ=mgc) 00000020:00000080:3.0:1782607756.301655:0:14186:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.104@tcp (ffff974577574d40) 00000020:00000080:3.0:1782607756.301670:0:14186:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1782607756.301744:0:14186:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9745509e6000@MGC192.168.202.104@tcp: add connection 192.168.202.104@tcp at head 00010000:00010000:3.0:1782607756.301916:0:14186:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.104@tcp-0 is initialized 00000040:01000000:3.0:1782607756.301922:0:14186:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.104@tcp ctxt 1 is initialized 00000100:00080000:2.0:1782607756.302195:0:14200:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1782607756.308818:0:14201:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1782607756.309198:0:14186:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.104@tcp (uuid 33f55b46-a882-437e-a0a1-2be6832a7ec1) 00000020:00000080:0.0:1782607756.309217:0:14186:0:(genops.c:1406:class_connect()) connect: client 33f55b46-a882-437e-a0a1-2be6832a7ec1, cookie 0x8109266df35cc139 00000100:00080000:0.0:1782607756.309227:0:14186:0:(import.c:512:import_select_connection()) MGC192.168.202.104@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782607756.309232:0:14186:0:(import.c:626:import_select_connection()) MGC192.168.202.104@tcp: import ffff9745509e6000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1782607756.309319:0:14186:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff974549e7fb80 x1869199364415360/t0(0) o250->MGC192.168.202.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782607756.309339:0:14186:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import 33f55b46-a882-437e-a0a1-2be6832a7ec1->MGS 00000100:00100000:2.0:1782607756.309374:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974549e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:33f55b46-a882-437e-a0a1-2be6832a7ec1:3315:1869199364415360:0@lo:250:mount.lustre.0 00000020:01000004:0.0:1782607756.309423:0:14186:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1782607756.309428:0:14186:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1782607756.309440:0:14186:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff97457f5f99c0) 00000100:00100000:2.0:1782607756.309445:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1782607756.309453:0:14186:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1782607756.310929:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364415360 00000100:00100000:3.0:1782607756.310940:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364415360 00000100:00100000:3.0:1782607756.310984:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782607756.310993:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549baa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3315:x1869199364415360:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1782607756.311016:0:14197:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 33f55b46-a882-437e-a0a1-2be6832a7ec1@0@lo t0 exp 0000000000000000 cur 415 last 0 00000020:00000080:3.0:1782607756.311052:0:14197:0:(genops.c:1406:class_connect()) connect: client 33f55b46-a882-437e-a0a1-2be6832a7ec1, cookie 0x8109266df35cc147 00000100:00080000:3.0:1782607756.311209:0:14197:0:(import.c:65:import_set_state_nolock()) ffff9745509e7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782607756.311287:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549baa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+5:3315:x1869199364415360:12345-0@lo:250:mount.lustre.0 Request processed in 294us (1841us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607756.311295:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782607756.311412:0:3315:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.202.104@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1782607756.311425:0:3315:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.202.104@tcp: connect to target with instance 0 00000100:00080000:2.0:1782607756.311434:0:3315:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.202.104@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1782607756.311441:0:3315:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1782607756.311447:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9745509e6000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1782607756.311450:0:3315:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1782607756.311472:0:3315:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1782607756.311489:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974549e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:33f55b46-a882-437e-a0a1-2be6832a7ec1:3315:1869199364415360:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1782607756.319918:0:14186:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782607756.320086:0:14186:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1782607756.320093:0:14186:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1782607756.320757:0:14186:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1782607756.320886:0:14186:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1782607756.321554:0:14186:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1782607756.321561:0:14186:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1782607756.322291:0:14186:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782607756.322451:0:14186:0:(service.c:3461:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1782607756.322456:0:14186:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1782607756.322928:0:14186:0:(service.c:3461:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1782607756.322940:0:14186:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1782607756.349117:0:14186:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782607756.349312:0:14186:0:(service.c:3461:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1782607756.349320:0:14186:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1782607756.350066:0:14186:0:(service.c:3461:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1782607756.350075:0:14186:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1782607756.351271:0:14186:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782607756.351412:0:14186:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1782607756.351416:0:14186:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1782607756.351754:0:14186:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1782607756.351760:0:14186:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1782607756.353039:0:14186:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782607756.353198:0:14186:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1782607756.353209:0:14186:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1782607756.354203:0:14186:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1782607756.354210:0:14186:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1782607756.356349:0:14186:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782607756.356519:0:14186:0:(service.c:3461:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1782607756.356525:0:14186:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1782607756.357994:0:14186:0:(service.c:3461:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1782607756.358004:0:14186:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1782607756.376623:0:14186:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782607756.376935:0:14186:0:(service.c:3461:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1782607756.376942:0:14186:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1782607756.378560:0:14186:0:(service.c:3461:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1782607756.378569:0:14186:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1782607756.379426:0:14186:0:(service.c:3461:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1782607756.379433:0:14186:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1782607756.380128:0:14186:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1782607756.380159:0:14186:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1782607756.380165:0:14186:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.104@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1782607756.380298:0:14186:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.104@tcp ctxt 0 is initialized 00000020:01000004:2.0:1782607756.380330:0:14186:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.104@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1782607756.380335:0:14186:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1782607756.380336:0:14186:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782607756.380338:0:14186:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782607756.380339:0:14186:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782607756.380340:0:14186:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782607756.380342:0:14186:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782607756.380343:0:14186:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782607756.380344:0:14186:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782607756.380346:0:14186:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782607756.380347:0:14186:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782607756.380350:0:14186:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1782607756.380353:0:14186:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782607756.380354:0:14186:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782607756.380355:0:14186:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782607756.380356:0:14186:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782607756.380357:0:14186:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782607756.380425:0:14186:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782607756.380427:0:14186:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782607756.380427:0:14186:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782607756.380429:0:14186:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782607756.380430:0:14186:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782607756.380457:0:14186:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1782607756.380488:0:14186:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974577609500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14186:1869199364415488:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1782607756.380569:0:14186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607756.380641:0:14186:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745486eb900 going to sleep for 11 seconds 00000100:00100000:0.0:1782607756.380713:0:14199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364415488 00000100:00100000:0.0:1782607756.380722:0:14199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364415488 00000100:00100000:0.0:1782607756.380796:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782607756.380805:0:14199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549ba9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+5:14186:x1869199364415488:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1782607756.380857:0:14199:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1782607756.380861:0:14199:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1782607756.380864:0:14199:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1782607756.381259:0:14220:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1782607756.382018:0:14199:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1782607756.383532:0:14221:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1782607756.383538:0:14221:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1782607756.383541:0:14221:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1782607756.383575:0:14221:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1782607756.384521:0:14199:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1782607756.384535:0:14199:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1782607756.392633:0:14199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549ba9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+5:14186:x1869199364415488:12345-0@lo:253:mount.lustre.0 Request processed in 11820us (12054us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607756.392653:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782607756.392731:0:14186:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974577609500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14186:1869199364415488:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1782607756.392746:0:14186:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1782607756.392749:0:14186:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782607756.392751:0:14186:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1782607756.392752:0:14186:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782607756.392753:0:14186:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782607756.392754:0:14186:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782607756.392755:0:14186:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782607756.392757:0:14186:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1782607756.392758:0:14186:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1782607756.392760:0:14186:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782607756.392761:0:14186:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1782607756.392950:0:14186:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9745812ef000 from lustre-MDT0000 10000000:01000000:0.0:1782607756.392990:0:14186:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1782607756.392994:0:14186:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1782607756.392998:0:14186:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff974577574d40 10000000:01000000:0.0:1782607756.393004:0:14186:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1782607756.393012:0:14186:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff974577574d40 from 1 10000000:01000000:0.0:1782607756.393015:0:14186:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1782607756.393058:0:14186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974546c42c00/0x8109266df35cc14e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607756.393069:0:14186:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974546c42c00/0x8109266df35cc14e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607756.393079:0:14186:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974546c42c00/0x8109266df35cc14e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607756.393100:0:14186:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974549e7d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14186:1869199364415616:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1782607756.393212:0:14186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607756.393659:0:14186:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745510ddb40 going to sleep for 11 seconds 00000100:00100000:2.0:1782607756.393710:0:14198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364415616 00000100:00100000:2.0:1782607756.393717:0:14198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364415616 00000100:00100000:2.0:1782607756.393875:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782607756.393886:0:14198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549bacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+5:14186:x1869199364415616:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782607756.393901:0:14198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607756.393919:0:14198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974541548400/0x8109266df35cc155 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cc14e expref: -99 pid: 14198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607756.393943:0:14198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974541548400/0x8109266df35cc155 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cc14e expref: 6 pid: 14198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607756.393954:0:14198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974541548400/0x8109266df35cc155 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cc14e expref: 6 pid: 14198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607756.393963:0:14198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974541548400, rc 0) 00000100:00100000:2.0:1782607756.394000:0:14198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549bacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+6:14186:x1869199364415616:12345-0@lo:101:mount.lustre.0 Request processed in 116us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607756.394006:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782607756.394081:0:14186:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974549e7d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14186:1869199364415616:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782607756.394095:0:14186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974546c42c00/0x8109266df35cc14e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc155 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607756.394104:0:14186:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974546c42c00/0x8109266df35cc14e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cc155 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607756.394171:0:14186:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974549e7d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14186:1869199364415744:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782607756.394196:0:14186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607756.394498:0:14186:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745510ddb40 going to sleep for 11 seconds 00000100:00100000:1.0:1782607756.394561:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364415744 00000100:00100000:1.0:1782607756.394566:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364415744 00000100:00100000:1.0:1782607756.394588:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782607756.394595:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549baec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+6:14186:x1869199364415744:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782607756.394863:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549baec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+6:14186:x1869199364415744:12345-0@lo:501:mount.lustre.0 Request processed in 267us (665us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782607756.394870:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782607756.394952:0:14186:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974549e7d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14186:1869199364415744:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1782607756.394989:0:14186:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1782607756.395005:0:14186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974546c42c00/0x8109266df35cc14e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc155 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607756.395014:0:14186:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974546c42c00/0x8109266df35cc14e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc155 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782607756.395023:0:14186:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9745812ef000 10000000:01000000:0.0:1782607756.395027:0:14186:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1782607756.395032:0:14186:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9745812ef000 10000000:01000000:0.0:1782607756.395035:0:14186:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1782607756.395038:0:14186:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9745812ef000 from 1 10000000:01000000:0.0:1782607756.395041:0:14186:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1782607756.395062:0:14186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974546c43600/0x8109266df35cc15c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607756.395069:0:14186:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974546c43600/0x8109266df35cc15c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607756.395078:0:14186:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974546c43600/0x8109266df35cc15c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607756.395092:0:14186:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974549e7d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14186:1869199364415872:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1782607756.395117:0:14186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607756.395151:0:14186:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745510ddb40 going to sleep for 11 seconds 00000100:00100000:2.0:1782607756.395491:0:14198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364415872 00000100:00100000:2.0:1782607756.395496:0:14198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364415872 00000100:00100000:2.0:1782607756.395521:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782607756.395528:0:14198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549badc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+6:14186:x1869199364415872:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782607756.395538:0:14198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607756.395550:0:14198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974541548a00/0x8109266df35cc163 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cc15c expref: -99 pid: 14198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607756.395575:0:14198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974541548a00/0x8109266df35cc163 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cc15c expref: 7 pid: 14198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607756.395585:0:14198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974541548a00/0x8109266df35cc163 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cc15c expref: 7 pid: 14198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607756.395593:0:14198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974541548a00, rc 0) 00000100:00100000:2.0:1782607756.395633:0:14198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549badc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+7:14186:x1869199364415872:12345-0@lo:101:mount.lustre.0 Request processed in 105us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607756.395638:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782607756.395719:0:14186:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974549e7d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14186:1869199364415872:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782607756.395732:0:14186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974546c43600/0x8109266df35cc15c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc163 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607756.395750:0:14186:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974546c43600/0x8109266df35cc15c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cc163 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782607756.395780:0:14186:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1782607756.395789:0:14186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974546c43600/0x8109266df35cc15c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc163 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607756.395796:0:14186:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974546c43600/0x8109266df35cc15c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc163 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782607756.395802:0:14186:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1782607756.395806:0:14186:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1782607756.395811:0:14186:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9745812ef000 10000000:01000000:0.0:1782607756.395814:0:14186:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1782607756.395817:0:14186:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1782607756.395819:0:14186:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1782607756.395833:0:14186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974546c43c00/0x8109266df35cc16a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607756.395840:0:14186:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974546c43c00/0x8109266df35cc16a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607756.395847:0:14186:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974546c43c00/0x8109266df35cc16a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607756.395861:0:14186:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974549e7d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14186:1869199364416000:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1782607756.395888:0:14186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607756.395908:0:14186:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745510ddb40 going to sleep for 11 seconds 00000100:00100000:1.0:1782607756.395975:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364416000 00000100:00100000:1.0:1782607756.395979:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364416000 00000100:00100000:1.0:1782607756.396000:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782607756.396006:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549bae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+7:14186:x1869199364416000:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782607756.396014:0:14197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607756.396026:0:14197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97457f467c00/0x8109266df35cc171 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cc16a expref: -99 pid: 14197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607756.396039:0:14197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97457f467c00/0x8109266df35cc171 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cc16a expref: 8 pid: 14197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607756.396048:0:14197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97457f467c00/0x8109266df35cc171 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cc16a expref: 8 pid: 14197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607756.396055:0:14197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97457f467c00, rc 0) 00000100:00100000:1.0:1782607756.396091:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549bae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+8:14186:x1869199364416000:12345-0@lo:101:mount.lustre.0 Request processed in 85us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607756.396097:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782607756.396175:0:14186:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974549e7d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14186:1869199364416000:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782607756.396187:0:14186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974546c43c00/0x8109266df35cc16a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc171 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607756.396194:0:14186:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974546c43c00/0x8109266df35cc16a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cc171 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607756.396465:0:14186:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974549e7d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14186:1869199364416128:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782607756.396504:0:14186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607756.396533:0:14186:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745510ddb40 going to sleep for 11 seconds 00000100:00100000:2.0:1782607756.396590:0:14198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364416128 00000100:00100000:2.0:1782607756.396594:0:14198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364416128 00000100:00100000:2.0:1782607756.396613:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782607756.396619:0:14198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549bafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+8:14186:x1869199364416128:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782607756.396965:0:14198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549bafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+9:14186:x1869199364416128:12345-0@lo:501:mount.lustre.0 Request processed in 345us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607756.396971:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782607756.397064:0:14186:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974549e7d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14186:1869199364416128:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782607756.397094:0:14186:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974549e7d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14186:1869199364416256:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782607756.397130:0:14186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607756.397163:0:14186:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745510ddb40 going to sleep for 11 seconds 00000100:00100000:2.0:1782607756.399855:0:14198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364416256 00000100:00100000:2.0:1782607756.399870:0:14198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364416256 00000100:00100000:2.0:1782607756.399919:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782607756.399928:0:14198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549baf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+9:14186:x1869199364416256:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782607756.401894:0:14198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549baf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+9:14186:x1869199364416256:12345-0@lo:503:mount.lustre.0 Request processed in 1960us (4757us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607756.401907:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782607756.402125:0:14186:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974549e7d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14186:1869199364416256:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782607756.403603:0:14222:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974549e7d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33f55b46-a882-437e-a0a1-2be6832a7ec1:14222:1869199364416384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782607756.403667:0:14222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607756.403715:0:14222:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745510dd900 going to sleep for 11 seconds 00000100:00100000:3.0:1782607756.403838:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364416384 00000100:00100000:3.0:1782607756.403845:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364416384 00000100:00100000:3.0:1782607756.403885:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782607756.403894:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549bac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+9:14222:x1869199364416384:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782607756.404642:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549bac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+9:14222:x1869199364416384:12345-0@lo:502:llog_process_th.0 Request processed in 747us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607756.404651:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782607756.404744:0:14222:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974549e7d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33f55b46-a882-437e-a0a1-2be6832a7ec1:14222:1869199364416384:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782607756.404838:0:14222:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782607756.404849:0:14222:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782607756.404851:0:14222:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1782607756.404857:0:14222:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1782607756.404860:0:14222:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782607756.404876:0:14222:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff97457f5fb380) 00000020:00000080:0.0:1782607756.404895:0:14222:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1782607756.404908:0:14222:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1782607756.404992:0:14222:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:0.0:1782607756.405001:0:14222:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8109266df35cc17f 00000020:00000080:0.0:1782607756.405592:0:14222:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1782607756.405597:0:14222:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782607756.405602:0:14222:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782607756.405603:0:14222:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1782607756.405607:0:14222:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782607756.405611:0:14222:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782607756.405612:0:14222:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1782607756.405615:0:14222:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782607756.405624:0:14222:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff97457f5f8000) 00000020:00000080:0.0:1782607756.405635:0:14222:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1782607756.405639:0:14222:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1782607756.405640:0:14222:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1782607756.405643:0:14222:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1782607756.405649:0:14222:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1782607756.405682:0:14222:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9745812ef000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1782607756.405694:0:14222:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff97457f5fcd40) 00000020:00000080:0.0:1782607756.405700:0:14222:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1782607756.405740:0:14222:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1782607756.405744:0:14222:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8109266df35cc194 00000020:00000080:0.0:1782607756.405931:0:14222:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1782607756.405938:0:14222:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1782607756.405943:0:14222:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x8109266df35cc19b 00080000:01000000:0.0:1782607756.405947:0:14222:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:0.0:1782607756.405951:0:14222:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8109266df35cc1a2 00010000:00010000:3.0:1782607756.512139:0:14222:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1782607756.517808:0:14222:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1782607756.518106:0:14222:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1782607756.529133:0:14222:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9745810c8000) 00000020:00000080:2.0:1782607756.529156:0:14222:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1782607756.529658:0:14222:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1782607756.529667:0:14222:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8109266df35cc1b0 00000020:00000080:1.0:1782607756.530674:0:14222:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1782607756.537046:0:14222:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x8109266df35cc1b7 00000020:00000080:2.0:1782607756.537570:0:14222:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1782607756.537584:0:14222:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782607756.537590:0:14222:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782607756.537592:0:14222:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1782607756.537597:0:14222:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782607756.537603:0:14222:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782607756.537605:0:14222:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1782607756.537609:0:14222:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1782607756.537648:0:14222:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1782607756.537667:0:14222:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782607756.537670:0:14222:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782607756.537671:0:14222:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1782607756.537674:0:14222:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1782607756.537675:0:14222:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1782607756.537676:0:14222:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1782607756.537678:0:14222:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1782607756.537679:0:14222:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1782607756.537681:0:14222:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782607756.537683:0:14222:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1782607756.537685:0:14222:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1782607756.537688:0:14222:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1782607756.537691:0:14222:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782607756.537692:0:14222:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1782607756.537696:0:14222:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1782607756.537702:0:14222:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.104@tcp to nid 0x20000c0a8ca68 (192.168.202.104@tcp) 00000020:01000000:2.0:1782607756.537742:0:14222:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1782607756.537745:0:14222:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782607756.537794:0:14222:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9745810cb380) 00000020:00000080:2.0:1782607756.537811:0:14222:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1782607756.537817:0:14222:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1782607756.537869:0:14222:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1782607756.537879:0:14222:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:2.0:1782607756.537885:0:14222:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8109266df35cc1c5 00010000:00080000:2.0:1782607756.537927:0:14222:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97456fd51800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.104@tcp at head 00010000:00010000:2.0:1782607756.538157:0:14222:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1782607756.538642:0:14222:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1782607756.538686:0:14222:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1782607756.540223:0:14222:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782607756.540650:0:14222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1782607756.540727:0:14222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1782607756.541573:0:14226:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1782607756.541579:0:14226:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1782607756.542564:0:14222:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782607756.542579:0:14222:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1782607756.542613:0:14222:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1782607756.542631:0:14222:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8109266df35cc1cc 00000100:00080000:2.0:1782607756.542642:0:14222:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782607756.542648:0:14222:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97456fd51800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1782607756.542684:0:14222:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97457760b480 x1869199364416512/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782607756.542718:0:14222:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1782607756.542816:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457760b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1869199364416512:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1782607756.542890:0:3315:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869199364416512 offset 0 length 520: 4 00000020:01000000:2.0:1782607756.543029:0:14222:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782607756.543034:0:14222:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782607756.543036:0:14222:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1782607756.543039:0:14222:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1782607756.543043:0:14222:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1782607756.543044:0:14222:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1782607756.543046:0:14222:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1782607756.543048:0:14222:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1782607756.543050:0:14222:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782607756.543051:0:14222:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1782607756.543053:0:14222:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1782607756.543058:0:14222:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1782607756.543061:0:14222:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782607756.543068:0:14222:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1782607756.543071:0:14222:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1782607756.543075:0:14222:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.104@tcp to nid 0x20000c0a8ca68 (192.168.202.104@tcp) 00000020:01000000:2.0:1782607756.543096:0:14222:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1782607756.543098:0:14222:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782607756.543111:0:14222:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9745810ccd40) 00000020:00000080:2.0:1782607756.543124:0:14222:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1782607756.543130:0:14222:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1782607756.543194:0:14222:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1782607756.543199:0:14222:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:2.0:1782607756.543205:0:14222:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8109266df35cc1da 00010000:00080000:2.0:1782607756.543357:0:14222:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97456fd52000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.104@tcp at head 00010000:00010000:2.0:1782607756.543574:0:14222:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1782607756.543788:0:14222:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1782607756.543811:0:14222:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1782607756.544505:0:14222:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782607756.544579:0:14222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1782607756.544647:0:14222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1782607756.545503:0:14228:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1782607756.545508:0:14228:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1782607756.554839:0:14222:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782607756.554853:0:14222:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1782607756.554889:0:14222:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1782607756.554905:0:14222:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8109266df35cc1e1 00000100:00080000:2.0:1782607756.554914:0:14222:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782607756.554921:0:14222:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97456fd52000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1782607756.554954:0:14222:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff974577609880 x1869199364416640/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782607756.554980:0:14222:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1782607756.555025:0:14222:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782607756.555042:0:14222:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782607756.555044:0:14222:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1782607756.555047:0:14222:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782607756.555052:0:14222:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782607756.555053:0:14222:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1782607756.555056:0:14222:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1782607756.555058:0:14222:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1782607756.555060:0:14222:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782607756.555063:0:14222:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782607756.555064:0:14222:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1782607756.555066:0:14222:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782607756.555069:0:14222:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782607756.555070:0:14222:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1782607756.555075:0:14222:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1782607756.555117:0:14222:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457760aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33f55b46-a882-437e-a0a1-2be6832a7ec1:14222:1869199364416768:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782607756.555207:0:14222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607756.555343:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974577609880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1869199364416640:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1782607756.555373:0:3315:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869199364416640 offset 0 length 520: 4 00000100:00100000:2.0:1782607756.555587:0:14222:0:(client.c:2701:ptlrpc_set_wait()) set ffff974544276600 going to sleep for 11 seconds 00000100:00100000:2.0:1782607756.561969:0:14199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364416768 00000100:00100000:2.0:1782607756.561984:0:14199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364416768 00000100:00100000:2.0:1782607756.562090:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782607756.562102:0:14199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549bae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+9:14222:x1869199364416768:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782607756.562438:0:14199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549bae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+9:14222:x1869199364416768:12345-0@lo:502:llog_process_th.0 Request processed in 338us (7230us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607756.562446:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782607756.564633:0:14222:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457760aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33f55b46-a882-437e-a0a1-2be6832a7ec1:14222:1869199364416768:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782607756.564682:0:14222:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782607756.564695:0:14222:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782607756.564697:0:14222:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1782607756.564703:0:14222:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1782607756.564906:0:14186:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1782607756.564932:0:14186:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1782607756.564969:0:14186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974546c43c00/0x8109266df35cc16a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc171 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607756.564981:0:14186:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974546c43c00/0x8109266df35cc16a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc171 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782607756.564989:0:14186:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9745812ef000 from 1 10000000:01000000:1.0:1782607756.564992:0:14186:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782607756.565033:0:14186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97457f466e00/0x8109266df35cc1e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607756.565043:0:14186:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff97457f466e00/0x8109266df35cc1e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607756.565051:0:14186:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff97457f466e00/0x8109266df35cc1e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607756.565072:0:14186:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14186:1869199364416896:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782607756.565126:0:14186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607756.569851:0:14186:0:(client.c:2701:ptlrpc_set_wait()) set ffff97457f927b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782607756.569965:0:14199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364416896 00000100:00100000:2.0:1782607756.569976:0:14199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364416896 00000100:00100000:2.0:1782607756.570023:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782607756.570032:0:14199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549bac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+9:14186:x1869199364416896:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782607756.570051:0:14199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607756.570074:0:14199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974541548e00/0x8109266df35cc1ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cc1e8 expref: -99 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607756.570124:0:14199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974541548e00/0x8109266df35cc1ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cc1e8 expref: 10 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607756.570136:0:14199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974541548e00/0x8109266df35cc1ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cc1e8 expref: 10 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607756.570147:0:14199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974541548e00, rc 0) 00000100:00100000:2.0:1782607756.570256:0:14199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549bac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+10:14186:x1869199364416896:12345-0@lo:101:mount.lustre.0 Request processed in 215us (5120us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607756.570262:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782607756.570559:0:14186:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14186:1869199364416896:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782607756.570574:0:14186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff97457f466e00/0x8109266df35cc1e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc1ef expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607756.570584:0:14186:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff97457f466e00/0x8109266df35cc1e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cc1ef expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607756.571160:0:14186:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14186:1869199364417024:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1782607756.571210:0:14186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607756.571447:0:14186:0:(client.c:2701:ptlrpc_set_wait()) set ffff97457f927b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782607756.571535:0:14199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364417024 00000100:00100000:2.0:1782607756.571541:0:14199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364417024 00000100:00100000:2.0:1782607756.571570:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782607756.571578:0:14199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549bae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+10:14186:x1869199364417024:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1782607756.571599:0:14199:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1782607756.571605:0:14199:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1782607756.571692:0:14199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549bae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+10:14186:x1869199364417024:12345-0@lo:256:mount.lustre.0 Request processed in 114us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607756.571698:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782607756.571892:0:14186:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14186:1869199364417024:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1782607756.572722:0:14186:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1782607756.572744:0:14186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97457f466e00/0x8109266df35cc1e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc1ef expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607756.572756:0:14186:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff97457f466e00/0x8109266df35cc1e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc1ef expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782607756.572815:0:14186:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9745812ef000 from 1 10000000:01000000:1.0:1782607756.572818:0:14186:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782607756.572852:0:14186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97457f466000/0x8109266df35cc1f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607756.572860:0:14186:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff97457f466000/0x8109266df35cc1f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607756.572869:0:14186:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff97457f466000/0x8109266df35cc1f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607756.572886:0:14186:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14186:1869199364417152:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782607756.572922:0:14186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607756.572952:0:14186:0:(client.c:2701:ptlrpc_set_wait()) set ffff97457f927b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782607756.573050:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364417152 00000100:00100000:3.0:1782607756.573056:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364417152 00000100:00100000:2.0:1782607756.573568:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782607756.573577:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549bad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+10:14186:x1869199364417152:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782607756.573589:0:14197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607756.573604:0:14197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974541549200/0x8109266df35cc1fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cc1f6 expref: -99 pid: 14197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607756.573626:0:14197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974541549200/0x8109266df35cc1fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cc1f6 expref: 11 pid: 14197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607756.573646:0:14197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974541549200/0x8109266df35cc1fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cc1f6 expref: 11 pid: 14197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607756.573654:0:14197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974541549200, rc 0) 00000100:00100000:2.0:1782607756.573706:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549bad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+11:14186:x1869199364417152:12345-0@lo:101:mount.lustre.0 Request processed in 130us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607756.573713:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782607756.573818:0:14186:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14186:1869199364417152:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782607756.573832:0:14186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff97457f466000/0x8109266df35cc1f6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc1fd expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607756.573847:0:14186:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff97457f466000/0x8109266df35cc1f6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cc1fd expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607756.573908:0:14186:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97444336a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14186:1869199364417280:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782607756.573936:0:14186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607756.573955:0:14186:0:(client.c:2701:ptlrpc_set_wait()) set ffff974550896e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782607756.574003:0:14199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364417280 00000100:00100000:2.0:1782607756.574007:0:14199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364417280 00000100:00100000:2.0:1782607756.574036:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782607756.574042:0:14199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549baf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+11:14186:x1869199364417280:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782607756.575458:0:14199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549baf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+11:14186:x1869199364417280:12345-0@lo:501:mount.lustre.0 Request processed in 1413us (1518us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607756.575469:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782607756.575561:0:14186:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97444336a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14186:1869199364417280:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782607756.575617:0:14186:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97444336a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14186:1869199364417408:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782607756.575664:0:14186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607756.575737:0:14186:0:(client.c:2701:ptlrpc_set_wait()) set ffff974550896e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782607756.575838:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364417408 00000100:00100000:2.0:1782607756.575844:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364417408 00000100:00100000:2.0:1782607756.575920:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782607756.575928:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549baf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+11:14186:x1869199364417408:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782607756.576097:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549baf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+11:14186:x1869199364417408:12345-0@lo:503:mount.lustre.0 Request processed in 169us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607756.576105:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782607756.576169:0:14186:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97444336a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14186:1869199364417408:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782607756.576914:0:14230:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97444336a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33f55b46-a882-437e-a0a1-2be6832a7ec1:14230:1869199364417536:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782607756.576959:0:14230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607756.577033:0:14230:0:(client.c:2701:ptlrpc_set_wait()) set ffff974550896e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782607756.577066:0:14199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364417536 00000100:00100000:2.0:1782607756.577071:0:14199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364417536 00000100:00100000:2.0:1782607756.577149:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782607756.577158:0:14199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549bad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+11:14230:x1869199364417536:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782607756.577552:0:14199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549bad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+11:14230:x1869199364417536:12345-0@lo:502:llog_process_th.0 Request processed in 395us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607756.577566:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782607756.577634:0:14230:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97444336a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33f55b46-a882-437e-a0a1-2be6832a7ec1:14230:1869199364417536:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782607756.577672:0:14230:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782607756.577683:0:14230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782607756.577687:0:14230:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1782607756.577696:0:14230:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9745812ef000 00000020:00000080:3.0:1782607756.577699:0:14230:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1782607756.577708:0:14230:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782607756.577710:0:14230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782607756.577712:0:14230:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1782607756.577714:0:14230:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782607756.577716:0:14230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782607756.577723:0:14230:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1782607756.577728:0:14230:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9745812ef000 00000020:00000080:3.0:1782607756.577730:0:14230:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1782607756.577833:0:14230:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782607756.577836:0:14230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782607756.577838:0:14230:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1782607756.577840:0:14230:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782607756.577843:0:14230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782607756.577845:0:14230:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1782607756.577848:0:14230:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9745812ef000 00000020:00000080:3.0:1782607756.577850:0:14230:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1782607756.577889:0:14230:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97444336a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33f55b46-a882-437e-a0a1-2be6832a7ec1:14230:1869199364417664:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782607756.577924:0:14230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607756.581925:0:14230:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745469d6480 going to sleep for 11 seconds 00000100:00100000:0.0:1782607756.585482:0:14198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364417664 00000100:00100000:0.0:1782607756.585511:0:14198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364417664 00000100:00100000:0.0:1782607756.585584:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782607756.585596:0:14198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549bad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+11:14230:x1869199364417664:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782607756.585926:0:14198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549bad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+11:14230:x1869199364417664:12345-0@lo:502:llog_process_th.0 Request processed in 331us (8000us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607756.585934:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782607756.587408:0:14230:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97444336a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33f55b46-a882-437e-a0a1-2be6832a7ec1:14230:1869199364417664:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782607756.587467:0:14230:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782607756.590575:0:14230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782607756.590578:0:14230:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1782607756.590589:0:14230:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1782607756.597663:0:14186:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1782607756.597715:0:14186:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782607756.597746:0:14186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97457f466000/0x8109266df35cc1f6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc1fd expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607756.597758:0:14186:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff97457f466000/0x8109266df35cc1f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc1fd expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782607756.597834:0:14186:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1782607756.597837:0:14186:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9745812ef000 10000000:01000000:3.0:1782607756.597840:0:14186:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9745812ef000 10000000:01000000:3.0:1782607756.597845:0:14186:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782607756.597858:0:14186:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9745812ef000 from 1 10000000:01000000:3.0:1782607756.597861:0:14186:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782607756.597909:0:14186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97455d648400/0x8109266df35cc204 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607756.597917:0:14186:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff97455d648400/0x8109266df35cc204 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607756.597931:0:14186:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff97455d648400/0x8109266df35cc204 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607756.597958:0:14186:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97444336a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14186:1869199364417792:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782607756.598029:0:14186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607756.598081:0:14186:0:(client.c:2701:ptlrpc_set_wait()) set ffff97454caabe40 going to sleep for 11 seconds 00000100:00100000:0.0:1782607756.598633:0:14198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364417792 00000100:00100000:0.0:1782607756.598641:0:14198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364417792 00000100:00100000:0.0:1782607756.598697:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782607756.598708:0:14198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549bac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+11:14186:x1869199364417792:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782607756.598724:0:14198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607756.598740:0:14198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974546c42600/0x8109266df35cc20b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cc204 expref: -99 pid: 14198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607756.598792:0:14198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974546c42600/0x8109266df35cc20b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cc204 expref: 12 pid: 14198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607756.598805:0:14198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974546c42600/0x8109266df35cc20b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cc204 expref: 12 pid: 14198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607756.598815:0:14198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c42600, rc 0) 00000100:00100000:0.0:1782607756.598862:0:14198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549bac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+12:14186:x1869199364417792:12345-0@lo:101:mount.lustre.0 Request processed in 156us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607756.598870:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782607756.599915:0:14186:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97444336a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14186:1869199364417792:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782607756.599939:0:14186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff97455d648400/0x8109266df35cc204 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc20b expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607756.599951:0:14186:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff97455d648400/0x8109266df35cc204 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cc20b expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607756.600039:0:14186:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97444336a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14186:1869199364417920:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782607756.600085:0:14186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607756.600120:0:14186:0:(client.c:2701:ptlrpc_set_wait()) set ffff97454caabe40 going to sleep for 11 seconds 00000100:00100000:1.0:1782607756.601382:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364417920 00000100:00100000:1.0:1782607756.601393:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364417920 00000100:00100000:1.0:1782607756.601449:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782607756.601461:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745770b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+12:14186:x1869199364417920:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782607756.601839:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745770b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+12:14186:x1869199364417920:12345-0@lo:501:mount.lustre.0 Request processed in 379us (1753us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607756.601855:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782607756.603487:0:14186:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97444336a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14186:1869199364417920:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782607756.603574:0:14186:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97444336a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14186:1869199364418048:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782607756.603649:0:14186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607756.606881:0:14186:0:(client.c:2701:ptlrpc_set_wait()) set ffff97454caabe40 going to sleep for 11 seconds 00000100:00100000:1.0:1782607756.614702:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364418048 00000100:00100000:1.0:1782607756.614721:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364418048 00000100:00100000:1.0:1782607756.614799:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782607756.614811:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745770b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+12:14186:x1869199364418048:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782607756.615060:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745770b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+12:14186:x1869199364418048:12345-0@lo:503:mount.lustre.0 Request processed in 252us (11412us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607756.615067:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782607756.615682:0:14186:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97444336a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14186:1869199364418048:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782607756.622807:0:14235:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974549e7d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33f55b46-a882-437e-a0a1-2be6832a7ec1:14235:1869199364418176:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782607756.622921:0:14235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607756.622967:0:14235:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745510dda80 going to sleep for 11 seconds 00000100:00100000:2.0:1782607756.623037:0:14199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364418176 00000100:00100000:2.0:1782607756.623045:0:14199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364418176 00000100:00100000:2.0:1782607756.623098:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782607756.623107:0:14199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745770b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+12:14235:x1869199364418176:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782607756.623411:0:14199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745770b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+12:14235:x1869199364418176:12345-0@lo:502:llog_process_th.0 Request processed in 304us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607756.623419:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782607756.623665:0:14235:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974549e7d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33f55b46-a882-437e-a0a1-2be6832a7ec1:14235:1869199364418176:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1782607756.623747:0:14235:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1782607756.623803:0:14235:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff97457af94d40) 00000020:00000080:0.0:1782607756.623831:0:14235:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1782607756.624030:0:14235:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9745812ef000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1782607756.624036:0:14235:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9745812ef000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1782607756.624039:0:14235:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9745812ef000 4 00010000:00080000:0.0:1782607756.624078:0:14235:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97457772f800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.104@tcp at head 00010000:00010000:1.0:1782607756.629520:0:14235:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1782607756.629631:0:14235:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1782607756.629677:0:14235:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1782607756.629693:0:14235:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x8109266df35cc219 00000100:00080000:1.0:1782607756.629705:0:14235:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782607756.629713:0:14235:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff97457772f800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1782607756.629750:0:14235:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97457f40ce00 x1869199364418304/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782607756.629793:0:14235:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1782607756.630212:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869199364418304:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1782607756.630305:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607756.630679:0:14235:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33f55b46-a882-437e-a0a1-2be6832a7ec1:14235:1869199364418432:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782607756.630728:0:14235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607756.630760:0:14235:0:(client.c:2701:ptlrpc_set_wait()) set ffff97457f834c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782607756.630933:0:14204:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364418304 00000100:00100000:2.0:1782607756.630940:0:14204:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364418304 00000100:00100000:2.0:1782607756.630980:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782607756.630987:0:14204:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549e7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3315:x1869199364418304:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1782607756.631043:0:14204:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549e7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3315:x1869199364418304:12345-0@lo:38:llog_process_th.0 Request processed in 55us (738us total) trans 0 rc -11/-11 00000100:00100000:2.0:1782607756.631050:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782607756.631342:0:14198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364418432 00000100:00100000:0.0:1782607756.631347:0:14198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364418432 00000100:00100000:0.0:1782607756.631386:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782607756.631393:0:14198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745770b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+12:14235:x1869199364418432:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782607756.631634:0:14198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745770b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+12:14235:x1869199364418432:12345-0@lo:502:llog_process_th.0 Request processed in 241us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607756.631642:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782607756.631694:0:3315:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782607756.631701:0:3315:0:(import.c:65:import_set_state_nolock()) ffff97457772f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782607756.631706:0:3315:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1782607756.631710:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869199364418304:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1782607756.631862:0:14235:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33f55b46-a882-437e-a0a1-2be6832a7ec1:14235:1869199364418432:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1782607756.631884:0:14235:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1782607756.632013:0:14186:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1782607756.632036:0:14186:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782607756.633580:0:14186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97455d648400/0x8109266df35cc204 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc20b expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607756.633598:0:14186:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff97455d648400/0x8109266df35cc204 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc20b expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1782607756.633660:0:14186:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1782607756.633662:0:14186:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782607756.633664:0:14186:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782607756.633665:0:14186:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782607756.633667:0:14186:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782607756.633672:0:14186:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782607756.633673:0:14186:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782607756.633675:0:14186:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782607756.633677:0:14186:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782607756.633678:0:14186:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782607756.633682:0:14186:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1782607756.633685:0:14186:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782607756.633686:0:14186:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782607756.633687:0:14186:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782607756.633688:0:14186:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782607756.633690:0:14186:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782607756.633691:0:14186:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782607756.633692:0:14186:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782607756.633693:0:14186:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782607756.633694:0:14186:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782607756.633695:0:14186:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782607756.633725:0:14186:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1782607756.633746:0:14186:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457760b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14186:1869199364418560:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1782607756.633853:0:14186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607756.633894:0:14186:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745715a70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782607756.641848:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364418560 00000100:00100000:1.0:1782607756.641866:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364418560 00000100:00100000:1.0:1782607756.641936:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782607756.641947:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745770b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+12:14186:x1869199364418560:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1782607756.642003:0:14197:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1782607756.642019:0:14197:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1782607756.682971:0:14197:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1782607756.682987:0:14197:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1782607756.683010:0:14220:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1782607756.683015:0:14220:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1782607756.683039:0:14220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff974541549a00/0x8109266df35cc220 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607756.683059:0:14220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff974541548e00/0x8109266df35cc1ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cc1e8 expref: 12 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607756.683068:0:14220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff974541549a00/0x8109266df35cc220 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607756.683110:0:14220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff974541548e00/0x8109266df35cc1ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8109266df35cc1e8 expref: 12 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607756.683142:0:14220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff974541548e00/0x8109266df35cc1ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8109266df35cc1e8 expref: 12 pid: 14199 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607756.683157:0:14220:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457760a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14220:1869199364418688:0@lo:104: 00000100:00100000:2.0:1782607756.683221:0:14220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607756.683549:0:14220:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745715a7300 going to sleep for 11 seconds 00000100:00100000:2.0:1782607756.683596:0:14187:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364418688 00000100:00100000:2.0:1782607756.683603:0:14187:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364418688 00000100:00100000:2.0:1782607756.683649:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782607756.683658:0:14187:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457760aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:33f55b46-a882-437e-a0a1-2be6832a7ec1+3:14220:x1869199364418688:12345-0@lo:104: 00010000:00010000:2.0:1782607756.683671:0:14187:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff97457f466e00/0x8109266df35cc1e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cc1ef expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607756.683714:0:14187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782607756.683719:0:14187:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457760aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:33f55b46-a882-437e-a0a1-2be6832a7ec1+3:14220:x1869199364418688:12345-0@lo:104: Request processed in 63us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607756.683726:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1782607756.684241:0:14193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782607756.684249:0:14193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff97457f466e00/0x8109266df35cc1e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cc1ef expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607756.684257:0:14193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f466e00 already unused, calling callback (ffffffffc1db0c20) 10000000:00010000:3.0:1782607756.684261:0:14193:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff97457f466e00/0x8109266df35cc1e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8109266df35cc1ef expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607756.684269:0:14193:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff97457f466e00/0x8109266df35cc1e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8109266df35cc1ef expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782607756.684277:0:14193:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff97457f466e00/0x8109266df35cc1e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8109266df35cc1ef expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782607756.684283:0:14193:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1782607756.684321:0:14193:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff97457f466e00/0x8109266df35cc1e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cc1ef expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607756.684328:0:14193:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782607756.684350:0:14193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff97457f466e00/0x8109266df35cc1e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cc1ef expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607756.684524:0:14193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff97457f466e00/0x8109266df35cc1e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cc1ef expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607756.684544:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607756.684546:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607756.684548:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782607756.684577:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97444336a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33f55b46-a882-437e-a0a1-2be6832a7ec1:3318:1869199364418816:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782607756.684630:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607756.684695:0:14189:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364418816 00000100:00100000:3.0:1782607756.684700:0:14189:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364418816 00010000:00010000:3.0:1782607756.684720:0:14189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff974541548e00/0x8109266df35cc1ef lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cc1e8 expref: 13 pid: 14199 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607756.684751:0:14189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782607756.684758:0:14189:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443368380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33f55b46-a882-437e-a0a1-2be6832a7ec1+13:3318:x1869199364418816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782607756.684789:0:14189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782607756.684795:0:14189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff974541548e00/0x8109266df35cc1ef lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cc1e8 expref: 13 pid: 14199 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607756.684807:0:14189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff974541548e00/0x8109266df35cc1ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8109266df35cc1e8 expref: 13 pid: 14199 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607756.684828:0:14189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff974541549a00/0x8109266df35cc220 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607756.684837:0:14189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974541549a00/0x8109266df35cc220 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1782607756.684853:0:14189:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001839305s 00010000:00010000:3.0:1782607756.684858:0:14189:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff974541549a00/0x8109266df35cc220 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607756.684865:0:14189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff974541549a00/0x8109266df35cc220 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607756.684872:0:14189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff974541549a00/0x8109266df35cc220 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607756.684888:0:14189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff974541549a00/0x8109266df35cc220 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607756.684894:0:14189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974541549a00 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:3.0:1782607756.684898:0:14189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff974541549a00/0x8109266df35cc220 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607756.684906:0:14189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff974541549a00/0x8109266df35cc220 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607756.684914:0:14189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff974541549a00/0x8109266df35cc220 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607756.684924:0:14189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782607756.684954:0:14189:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443368380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33f55b46-a882-437e-a0a1-2be6832a7ec1+13:3318:x1869199364418816:12345-0@lo:103:ldlm_bl.0 Request processed in 197us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607756.684962:0:14189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782607756.684998:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97444336a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33f55b46-a882-437e-a0a1-2be6832a7ec1:3318:1869199364418816:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782607756.685036:0:14220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974541548e00/0x8109266df35cc1ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8109266df35cc1e8 expref: 12 pid: 14199 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607756.685048:0:14220:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457760a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14220:1869199364418688:0@lo:104: 00010000:00010000:3.0:1782607756.685059:0:14220:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff974541549a00/0x8109266df35cc220 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607756.685068:0:14220:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff974541549a00/0x8109266df35cc220 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607756.685083:0:14220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff974541549a00/0x8109266df35cc220 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607756.685090:0:14220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974541549a00/0x8109266df35cc220 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607756.697103:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745770b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+11:14186:x1869199364418560:12345-0@lo:253:mount.lustre.0 Request processed in 55141us (63235us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607756.697122:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782607756.697292:0:14186:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457760b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14186:1869199364418560:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1782607756.697314:0:14186:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1782607756.697318:0:14186:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782607756.697320:0:14186:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782607756.697321:0:14186:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782607756.697323:0:14186:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782607756.697324:0:14186:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782607756.697326:0:14186:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782607756.697327:0:14186:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782607756.697328:0:14186:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782607756.697330:0:14186:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782607756.697332:0:14186:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1782607756.697352:0:14186:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1782607756.702924:0:14186:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1782607756.703095:0:14186:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1782607756.703502:0:14186:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1782607756.703657:0:14186:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1782607756.703955:0:14186:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1782607756.704108:0:14186:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1782607756.705189:0:14186:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1782607756.705575:0:14186:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1782607756.705851:0:14186:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1782607756.706086:0:14186:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1782607756.706509:0:14186:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1782607756.706669:0:14186:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1782607756.731810:0:14186:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1782607756.732407:0:14186:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1782607756.732454:0:14241:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1782607756.732458:0:14241:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1782607756.733178:0:14242:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1782607756.735460:0:14186:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1782607756.735601:0:14186:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1782607756.736081:0:14186:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1782607756.736089:0:14186:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1782607756.736216:0:14186:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782607756.736718:0:14242:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782607756.740447:0:14242:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1782607756.740531:0:14242:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1782607756.740536:0:14242:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:0.0:1782607756.740744:0:14186:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1782607756.741616:0:14186:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1782607756.741653:0:14186:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1782607756.743430:0:14186:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1782607756.747944:0:14186:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1782607756.766749:0:14186:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1782607756.766816:0:14186:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffba98c1ccf988 00100000:10000000:0.0:1782607756.766824:0:14186:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1782607756.767672:0:14186:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1782607756.767689:0:14186:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.104@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1782607756.767702:0:14186:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1782607756.767719:0:14186:0:(super25.c:188:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1782607757.316237:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782607757.441829:0:14201:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1782607757.441836:0:14201:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9745812ef000 from 6 10000000:01000000:2.0:1782607757.441842:0:14201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782607757.441891:0:14201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974541548e00/0x8109266df35cc227 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607757.441904:0:14201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974541548e00/0x8109266df35cc227 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607757.441915:0:14201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974541548e00/0x8109266df35cc227 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607757.441937:0:14201:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974577609500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33f55b46-a882-437e-a0a1-2be6832a7ec1:14201:1869199364418944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782607757.442004:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607757.442056:0:14201:0:(client.c:2701:ptlrpc_set_wait()) set ffff974577a59240 going to sleep for 11 seconds 00000100:00100000:0.0:1782607757.442058:0:14199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364418944 00000100:00100000:0.0:1782607757.442066:0:14199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364418944 00000100:00100000:0.0:1782607757.442119:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782607757.442128:0:14199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745770b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+11:14201:x1869199364418944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782607757.442143:0:14199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607757.442157:0:14199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974546c42200/0x8109266df35cc22e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cc227 expref: -99 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607757.442181:0:14199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974546c42200/0x8109266df35cc22e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cc227 expref: 12 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607757.442191:0:14199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974546c42200/0x8109266df35cc22e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cc227 expref: 12 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607757.442213:0:14199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c42200, rc 0) 00000100:00100000:0.0:1782607757.442251:0:14199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745770b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+12:14201:x1869199364418944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607757.442258:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782607757.442280:0:14201:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974577609500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33f55b46-a882-437e-a0a1-2be6832a7ec1:14201:1869199364418944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782607757.442294:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974541548e00/0x8109266df35cc227 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc22e expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607757.442304:0:14201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974541548e00/0x8109266df35cc227 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cc22e expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607757.442352:0:14201:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974577609500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33f55b46-a882-437e-a0a1-2be6832a7ec1:14201:1869199364419072:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1782607757.442388:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607757.442409:0:14201:0:(client.c:2701:ptlrpc_set_wait()) set ffff974577a59240 going to sleep for 11 seconds 00000100:00100000:0.0:1782607757.442598:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364419072 00000100:00100000:0.0:1782607757.442603:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364419072 00000100:00100000:0.0:1782607757.442677:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782607757.442685:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745770b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+12:14201:x1869199364419072:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1782607757.442700:0:14197:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1782607757.442714:0:14197:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1782607757.442717:0:14197:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1782607757.442845:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745770b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+12:14201:x1869199364419072:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 160us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607757.442853:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1782607757.442921:0:14201:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974577609500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33f55b46-a882-437e-a0a1-2be6832a7ec1:14201:1869199364419072:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1782607757.442975:0:14201:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1782607757.442983:0:14201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974541548e00/0x8109266df35cc227 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc22e expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607757.442991:0:14201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974541548e00/0x8109266df35cc227 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc22e expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782607757.634812:0:14236:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1782607758.340436:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782607758.658641:0:14236:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1782607759.365443:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607760.388034:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607761.409925:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782607761.761108:0:14485:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1782607761.992915:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782607761.992923:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1782607761.992926:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782607761.992930:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1782607761.992933:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1782607761.992937:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1782607761.992940:0:36:0:(import.c:65:import_set_state_nolock()) ffff97457772f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782607761.992954:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff97457772f800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1782607761.992978:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97457f40ce00 x1869199364419328/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782607761.993017:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33f55b46-a882-437e-a0a1-2be6832a7ec1:3319:1869199364419200:0@lo:400:kworker.0 00000100:00100000:1.0:1782607761.993084:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607761.993161:0:14198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364419200 00000100:00100000:1.0:1782607761.993169:0:14198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364419200 00000100:00100000:1.0:1782607761.993213:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782607761.993221:0:14198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745770b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+12:3319:x1869199364419200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607761.993272:0:14198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745770b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+12:3319:x1869199364419200:12345-0@lo:400:kworker.0 Request processed in 51us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607761.993279:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782607761.993330:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33f55b46-a882-437e-a0a1-2be6832a7ec1:3319:1869199364419200:0@lo:400:kworker.0 00000100:00100000:2.0:1782607761.995903:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869199364419328:0@lo:38:kworker.0 00000100:00100000:2.0:1782607761.995983:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607761.996108:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364419328 00000100:00100000:2.0:1782607761.996116:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364419328 00000100:00100000:2.0:1782607761.996148:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782607761.996155:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974577609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3315:x1869199364419328:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1782607761.996182:0:14206:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 420 last 0 00000020:00000080:2.0:1782607761.996219:0:14206:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x8109266df35cc235 00000004:00100000:2.0:1782607761.996235:0:14206:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1782607761.996377:0:14206:0:(import.c:65:import_set_state_nolock()) ffff97454a72f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782607761.996429:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974577609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869199364419328:12345-0@lo:38:kworker.0 Request processed in 272us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607761.996448:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1782607761.996495:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97457f40ce00 x1869199364419328/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782607771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1782607761.996510:0:3315:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1782607761.996518:0:3315:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1782607761.996523:0:3315:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1782607761.996525:0:3315:0:(import.c:65:import_set_state_nolock()) ffff97457772f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1782607761.996531:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869199364419328:0@lo:38:kworker.0 00010000:00010000:2.0:1782607762.434030:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607763.459470:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607764.485890:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782607764.722489:0:14635:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff5c97e8f0 20000000:00000080:3.0:1782607764.722509:0:14635:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97457aeab800 uarg=0000000000000000 20000000:01000000:3.0:1782607764.722544:0:14635:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1782607764.722552:0:14635:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1782607764.722556:0:14635:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1782607764.723869:0:14636:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1782607764.724035:0:14635:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1782607764.742984:0:14635:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1782607764.743164:0:14635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97455d648e00/0x8109266df35cc23c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607764.743194:0:14635:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff974541549200/0x8109266df35cc1fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cc1f6 expref: 11 pid: 14197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607764.743202:0:14635:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97455d648e00/0x8109266df35cc23c lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607764.743249:0:14635:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff974541549200/0x8109266df35cc1fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8109266df35cc1f6 expref: 11 pid: 14197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607764.744032:0:14635:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff974541549200/0x8109266df35cc1fd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8109266df35cc1f6 expref: 11 pid: 14197 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607764.744086:0:14635:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97444336a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14635:1869199364419456:0@lo:104: 00000100:00100000:3.0:1782607764.744270:0:14635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607764.744451:0:14635:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745412533c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782607764.744531:0:14188:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364419456 00000100:00100000:0.0:1782607764.744539:0:14188:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364419456 00000100:00100000:0.0:1782607764.744589:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782607764.744599:0:14188:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97444336b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33f55b46-a882-437e-a0a1-2be6832a7ec1+3:14635:x1869199364419456:12345-0@lo:104: 00010000:00010000:0.0:1782607764.744613:0:14188:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff97457f466000/0x8109266df35cc1f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cc1fd expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607764.744689:0:14188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782607764.744695:0:14188:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97444336b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33f55b46-a882-437e-a0a1-2be6832a7ec1+3:14635:x1869199364419456:12345-0@lo:104: Request processed in 98us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607764.744712:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1782607764.744972:0:14192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782607764.744986:0:14192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff97457f466000/0x8109266df35cc1f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cc1fd expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607764.744995:0:14192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f466000 already unused, calling callback (ffffffffc1db0c20) 10000000:00010000:2.0:1782607764.744999:0:14192:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff97457f466000/0x8109266df35cc1f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8109266df35cc1fd expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607764.745017:0:14192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff97457f466000/0x8109266df35cc1f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8109266df35cc1fd expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782607764.745026:0:14192:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff97457f466000/0x8109266df35cc1f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8109266df35cc1fd expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782607764.745032:0:14192:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782607764.745069:0:14192:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff97457f466000/0x8109266df35cc1f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cc1fd expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607764.745075:0:14192:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782607764.745102:0:14192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff97457f466000/0x8109266df35cc1f6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cc1fd expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607764.745110:0:14192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff97457f466000/0x8109266df35cc1f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cc1fd expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607764.745125:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607764.745126:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607764.745128:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782607764.745145:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782607764.745155:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457760ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33f55b46-a882-437e-a0a1-2be6832a7ec1:3317:1869199364419584:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782607764.745188:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607764.745232:0:14189:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364419584 00000100:00100000:2.0:1782607764.745242:0:14189:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364419584 00010000:00010000:2.0:1782607764.745261:0:14189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff974541549200/0x8109266df35cc1fd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cc1f6 expref: 12 pid: 14197 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607764.745283:0:14189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782607764.745288:0:14189:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974577608a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33f55b46-a882-437e-a0a1-2be6832a7ec1+12:3317:x1869199364419584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782607764.745418:0:14189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782607764.745424:0:14189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff974541549200/0x8109266df35cc1fd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cc1f6 expref: 12 pid: 14197 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607764.745436:0:14189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff974541549200/0x8109266df35cc1fd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8109266df35cc1f6 expref: 12 pid: 14197 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607764.745454:0:14189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97455d648e00/0x8109266df35cc23c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607764.745462:0:14189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97455d648e00/0x8109266df35cc23c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607764.745477:0:14189:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97455d648e00/0x8109266df35cc23c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607764.745485:0:14189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97455d648e00/0x8109266df35cc23c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607764.745491:0:14189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97455d648e00/0x8109266df35cc23c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607764.745497:0:14189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97455d648e00/0x8109266df35cc23c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607764.745504:0:14189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d648e00 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:2.0:1782607764.745514:0:14189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97455d648e00/0x8109266df35cc23c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607764.745522:0:14189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97455d648e00/0x8109266df35cc23c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607764.745530:0:14189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97455d648e00/0x8109266df35cc23c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607764.745541:0:14189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782607764.745848:0:14635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974541549200/0x8109266df35cc1fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8109266df35cc1f6 expref: 12 pid: 14197 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607764.745861:0:14635:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97444336a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14635:1869199364419456:0@lo:104: 00010000:00010000:3.0:1782607764.745884:0:14635:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97455d648e00/0x8109266df35cc23c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607764.745892:0:14635:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97455d648e00/0x8109266df35cc23c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607764.745898:0:14635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97455d648e00/0x8109266df35cc23c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607764.745904:0:14635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97455d648e00/0x8109266df35cc23c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607764.751371:0:14189:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974577608a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33f55b46-a882-437e-a0a1-2be6832a7ec1+11:3317:x1869199364419584:12345-0@lo:103:ldlm_bl.0 Request processed in 6072us (6172us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607764.751386:0:14189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782607764.756539:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457760ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33f55b46-a882-437e-a0a1-2be6832a7ec1:3317:1869199364419584:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782607765.505933:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782607766.081953:0:3315:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782607756/real 1782607756] req@ffff974577609880 x1869199364416640/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782607766 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782607766.081989:0:3315:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff974577609880 x1869199364416640/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782607766 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782607766.082000:0:3315:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782607756/real 1782607756] req@ffff97457760b480 x1869199364416512/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782607766 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782607766.082016:0:3315:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97457760b480 x1869199364416512/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782607766 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1782607766.082035:0:3315:0:(import.c:65:import_set_state_nolock()) ffff97456fd52000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782607766.082055:0:3315:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1782607766.082059:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974577609880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1869199364416640:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1782607766.082067:0:3315:0:(import.c:65:import_set_state_nolock()) ffff97456fd51800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782607766.082072:0:3315:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1782607766.082074:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457760b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1869199364416512:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1782607766.082276:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782607766.082281:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1782607766.082284:0:37:0:(import.c:65:import_set_state_nolock()) ffff97456fd51800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782607766.082289:0:37:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 415 00000100:00080000:3.0:1782607766.082294:0:37:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1782607766.082301:0:37:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97456fd51800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1782607766.082321:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff974443369500 x1869199364419840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782607766.082339:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782607766.082342:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1782607766.082344:0:37:0:(import.c:65:import_set_state_nolock()) ffff97456fd52000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782607766.082347:0:37:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 415 00000100:00080000:3.0:1782607766.082350:0:37:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1782607766.082353:0:37:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97456fd52000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1782607766.082365:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97444336ad80 x1869199364419968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782607766.082419:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97444336b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1869199364420096:0@lo:400:kworker.0 00000100:00100000:3.0:1782607766.082493:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607766.082590:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782607766.082600:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97444336a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33f55b46-a882-437e-a0a1-2be6832a7ec1:3316:1869199364419712:0@lo:400:kworker.0 00000100:00100000:1.0:1782607766.082631:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607766.082691:0:14205:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364420096 00000100:00100000:1.0:1782607766.082698:0:14205:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364420096 00000100:00100000:1.0:1782607766.082735:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782607766.082743:0:14205:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97444336b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1869199364420096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607766.082827:0:14205:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97444336b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1869199364420096:12345-0@lo:400:kworker.0 Request processed in 84us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607766.082834:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782607766.083321:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364419712 00000100:00100000:3.0:1782607766.083327:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364419712 00000100:00100000:3.0:1782607766.083366:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782607766.083372:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745770b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+11:3316:x1869199364419712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607766.083435:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745770b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+11:3316:x1869199364419712:12345-0@lo:400:kworker.0 Request processed in 55us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607766.083456:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1782607766.083502:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97444336b480 x1869199364420096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782607782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607766.083516:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97444336b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1869199364420096:0@lo:400:kworker.0 00000100:00100000:0.0:1782607766.083612:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97444336a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33f55b46-a882-437e-a0a1-2be6832a7ec1:3316:1869199364419712:0@lo:400:kworker.0 00000100:00100000:2.0:1782607766.085045:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974443369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1869199364419840:0@lo:8:kworker.0 00000400:00000100:2.0:1782607766.085096:0:3315:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869199364419840 offset 0 length 520: 4 00000100:00100000:2.0:1782607766.085130:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97444336ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1869199364419968:0@lo:8:kworker.0 00000400:00000100:2.0:1782607766.085150:0:3315:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869199364419968 offset 0 length 520: 4 10000000:01000000:2.0:1782607766.342099:0:14201:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782607766.342107:0:14201:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9745812ef000 from 10 10000000:01000000:2.0:1782607766.342112:0:14201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782607766.342161:0:14201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974541549200/0x8109266df35cc243 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607766.342173:0:14201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974541549200/0x8109266df35cc243 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607766.342184:0:14201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974541549200/0x8109266df35cc243 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607766.342213:0:14201:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457760bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33f55b46-a882-437e-a0a1-2be6832a7ec1:14201:1869199364420224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782607766.342320:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607766.342385:0:14201:0:(client.c:2701:ptlrpc_set_wait()) set ffff974543d79840 going to sleep for 11 seconds 00000100:00100000:1.0:1782607766.342674:0:14199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364420224 00000100:00100000:1.0:1782607766.342681:0:14199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364420224 00000100:00100000:1.0:1782607766.342732:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782607766.342740:0:14199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745770b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+11:14201:x1869199364420224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782607766.342753:0:14199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607766.342787:0:14199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97457f466e00/0x8109266df35cc24a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cc243 expref: -99 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607766.342811:0:14199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97457f466e00/0x8109266df35cc24a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cc243 expref: 12 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607766.342827:0:14199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97457f466e00/0x8109266df35cc24a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cc243 expref: 12 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607766.342836:0:14199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97457f466e00, rc 0) 00000100:00100000:1.0:1782607766.342892:0:14199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745770b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+12:14201:x1869199364420224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607766.342898:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782607766.342940:0:14201:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457760bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33f55b46-a882-437e-a0a1-2be6832a7ec1:14201:1869199364420224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782607766.342953:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974541549200/0x8109266df35cc243 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc24a expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607766.342961:0:14201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974541549200/0x8109266df35cc243 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cc24a expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607766.343013:0:14201:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33f55b46-a882-437e-a0a1-2be6832a7ec1:14201:1869199364420352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782607766.343034:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607766.343046:0:14201:0:(client.c:2701:ptlrpc_set_wait()) set ffff974543959180 going to sleep for 11 seconds 00000100:00100000:1.0:1782607766.343057:0:14198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364420352 00000100:00100000:1.0:1782607766.343060:0:14198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364420352 00000100:00100000:1.0:1782607766.343076:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782607766.343081:0:14198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745770b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+12:14201:x1869199364420352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782607766.343538:0:14198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745770b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+12:14201:x1869199364420352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 455us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607766.343545:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782607766.343617:0:14201:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33f55b46-a882-437e-a0a1-2be6832a7ec1:14201:1869199364420352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782607766.343646:0:14201:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974549e7fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33f55b46-a882-437e-a0a1-2be6832a7ec1:14201:1869199364420480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782607766.343681:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607766.343712:0:14201:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745486b40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782607766.351125:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364420480 00000100:00100000:1.0:1782607766.351140:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364420480 00000100:00100000:1.0:1782607766.351219:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782607766.351230:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745770b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+12:14201:x1869199364420480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782607766.351534:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745770b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+12:14201:x1869199364420480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 306us (7851us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607766.351542:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782607766.351616:0:14201:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974549e7fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33f55b46-a882-437e-a0a1-2be6832a7ec1:14201:1869199364420480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782607766.352482:0:14699:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1782607766.352534:0:14201:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1782607766.352550:0:14201:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782607766.352559:0:14201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974541549200/0x8109266df35cc243 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc24a expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607766.352571:0:14201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974541549200/0x8109266df35cc243 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc24a expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607766.530506:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607767.562671:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607768.586387:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782607768.898805:0:14236:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:2.0:1782607769.231570:0:14836:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1782607769.231574:0:14836:0:(obd_mount.c:917:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1782607769.231692:0:14836:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff97454a72d000 00000020:01000004:2.0:1782607769.231709:0:14836:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1782607769.231723:0:14836:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1782607769.231737:0:14836:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9745810c99c0) 00000020:00000080:2.0:1782607769.231757:0:14836:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1782607769.248177:0:14836:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1782607769.248588:0:14836:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1782607769.249687:0:14836:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1782607769.250007:0:14836:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1782607769.250201:0:14836:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1782607769.255667:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 347: rc = 0 00100000:10000000:3.0:1782607769.255839:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 347: rc = 0 00100000:10000000:3.0:1782607769.255945:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 347: rc = 0 00100000:10000000:3.0:1782607769.256434:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 768: rc = 0 00100000:10000000:3.0:1782607769.256683:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 768: rc = 0 00100000:10000000:3.0:1782607769.256967:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 768: rc = 0 00100000:10000000:3.0:1782607769.257217:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 768: rc = 0 00100000:10000000:3.0:1782607769.257464:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 768: rc = 0 00100000:10000000:3.0:1782607769.257696:0:14836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 768: rc = 0 00000020:00000080:3.0:1782607769.262667:0:14836:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1782607769.262680:0:14836:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1782607769.262693:0:14836:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8109266df35cc258 00000020:01000004:3.0:1782607769.262702:0:14836:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1782607769.262724:0:14836:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.202.104@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1782607769.262727:0:14836:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1782607769.262734:0:14836:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1782607769.262745:0:14836:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1782607769.262757:0:14836:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff974577573380) 00000020:00000080:3.0:1782607769.262793:0:14836:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1782607769.272332:0:14836:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782607769.272546:0:14836:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1782607769.272552:0:14836:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1782607769.272937:0:14836:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1782607769.272943:0:14836:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1782607769.273087:0:14836:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1782607769.273092:0:14836:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1782607769.285343:0:14836:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782607769.285531:0:14836:0:(service.c:3461:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1782607769.285537:0:14836:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1782607769.288481:0:14836:0:(service.c:3461:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1782607769.288495:0:14836:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1782607769.312057:0:14836:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782607769.312395:0:14836:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1782607769.312403:0:14836:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1782607769.313718:0:14836:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1782607769.313726:0:14836:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1782607769.314725:0:14836:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1782607769.314732:0:14836:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1782607769.317304:0:14836:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782607769.317517:0:14836:0:(service.c:3461:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1782607769.317524:0:14836:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1782607769.318355:0:14836:0:(service.c:3461:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1782607769.318363:0:14836:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1782607769.354711:0:14836:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782607769.355019:0:14836:0:(service.c:3461:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1782607769.355028:0:14836:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1782607769.356384:0:14836:0:(service.c:3461:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1782607769.356394:0:14836:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1782607769.356960:0:14836:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1782607769.356990:0:14836:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1782607769.356997:0:14836:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.104@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1782607769.366320:0:14836:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.104@tcp ctxt 0 is initialized 00000020:01000004:0.0:1782607769.366369:0:14836:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.104@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1782607769.366383:0:14836:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1782607769.366385:0:14836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782607769.366386:0:14836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782607769.366387:0:14836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782607769.366388:0:14836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782607769.366389:0:14836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782607769.366391:0:14836:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782607769.366393:0:14836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782607769.366394:0:14836:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782607769.366399:0:14836:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1782607769.366401:0:14836:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782607769.366402:0:14836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782607769.366403:0:14836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782607769.366404:0:14836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782607769.366406:0:14836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782607769.366407:0:14836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782607769.366408:0:14836:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782607769.366409:0:14836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782607769.366410:0:14836:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782607769.366435:0:14836:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1782607769.366457:0:14836:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974549e7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14836:1869199364420608:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1782607769.366529:0:14836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607769.366639:0:14836:0:(client.c:2701:ptlrpc_set_wait()) set ffff97455828b840 going to sleep for 11 seconds 00000100:00100000:1.0:1782607769.366686:0:14198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364420608 00000100:00100000:1.0:1782607769.366695:0:14198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364420608 00000100:00100000:1.0:1782607769.366845:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1782607769.366924:0:14198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745770b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+12:14836:x1869199364420608:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1782607769.366961:0:14198:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1782607769.366963:0:14198:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1782607769.366968:0:14198:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1782607769.371596:0:14198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745770b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+12:14836:x1869199364420608:12345-0@lo:253:mount.lustre.0 Request processed in 4662us (5055us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607769.371615:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782607769.371738:0:14836:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974549e7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14836:1869199364420608:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1782607769.371755:0:14836:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1782607769.371758:0:14836:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782607769.371797:0:14836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782607769.371799:0:14836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782607769.371800:0:14836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782607769.371802:0:14836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782607769.371803:0:14836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782607769.371805:0:14836:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782607769.371807:0:14836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782607769.371808:0:14836:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1782607769.371830:0:14836:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97454a72d000 from lustre-OST0000 10000000:01000000:0.0:1782607769.371968:0:14836:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1782607769.371972:0:14836:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1782607769.371979:0:14836:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff974577574d40 local copy 00010000:00010000:0.0:1782607769.371994:0:14836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974546c42c00/0x8109266df35cc14e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc155 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607769.372212:0:14836:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974549e7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14836:1869199364420736:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782607769.372244:0:14836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607769.372289:0:14836:0:(client.c:2701:ptlrpc_set_wait()) set ffff97455828bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1782607769.372400:0:14199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364420736 00000100:00100000:2.0:1782607769.372406:0:14199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364420736 00000100:00100000:2.0:1782607769.372449:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1782607769.372457:0:14199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745770b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+12:14836:x1869199364420736:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782607769.372680:0:14199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745770b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+12:14836:x1869199364420736:12345-0@lo:501:mount.lustre.0 Request processed in 222us (434us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782607769.372697:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782607769.372757:0:14836:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974549e7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14836:1869199364420736:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1782607769.372788:0:14836:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1782607769.373005:0:14836:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1782607769.373012:0:14836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974546c42c00/0x8109266df35cc14e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc155 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607769.373022:0:14836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974546c42c00/0x8109266df35cc14e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc155 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782607769.373043:0:14836:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97454a72d000 10000000:01000000:3.0:1782607769.373048:0:14836:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1782607769.373053:0:14836:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff974577574d40 10000000:01000000:3.0:1782607769.373055:0:14836:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1782607769.373064:0:14836:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff974577574d40 from 1 10000000:01000000:3.0:1782607769.373067:0:14836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782607769.373092:0:14836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97455d648e00/0x8109266df35cc266 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607769.373101:0:14836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff97455d648e00/0x8109266df35cc266 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607769.373111:0:14836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff97455d648e00/0x8109266df35cc266 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607769.373126:0:14836:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97444336b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14836:1869199364420864:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782607769.373154:0:14836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607769.373220:0:14836:0:(client.c:2701:ptlrpc_set_wait()) set ffff97456a83f540 going to sleep for 11 seconds 00000100:00100000:2.0:1782607769.373355:0:14198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364420864 00000100:00100000:2.0:1782607769.373359:0:14198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364420864 00000100:00100000:2.0:1782607769.373435:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782607769.373443:0:14198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745770b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+12:14836:x1869199364420864:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782607769.373452:0:14198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607769.373465:0:14198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974541548c00/0x8109266df35cc26d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cc266 expref: -99 pid: 14198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607769.373488:0:14198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974541548c00/0x8109266df35cc26d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cc266 expref: 13 pid: 14198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607769.373499:0:14198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974541548c00/0x8109266df35cc26d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cc266 expref: 13 pid: 14198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607769.373508:0:14198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974541548c00, rc 0) 00000100:00100000:2.0:1782607769.373546:0:14198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745770b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+13:14836:x1869199364420864:12345-0@lo:101:mount.lustre.0 Request processed in 105us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607769.373552:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782607769.373612:0:14836:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97444336b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14836:1869199364420864:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782607769.373625:0:14836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff97455d648e00/0x8109266df35cc266 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc26d expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607769.373634:0:14836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff97455d648e00/0x8109266df35cc266 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cc26d expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782607769.373654:0:14836:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782607769.373671:0:14836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97455d648e00/0x8109266df35cc266 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc26d expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607769.373677:0:14836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff97455d648e00/0x8109266df35cc266 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc26d expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782607769.373685:0:14836:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1782607769.373696:0:14836:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782607769.373701:0:14836:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1782607769.373703:0:14836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1782607769.373719:0:14836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97455d648200/0x8109266df35cc274 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607769.373726:0:14836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff97455d648200/0x8109266df35cc274 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607769.373733:0:14836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff97455d648200/0x8109266df35cc274 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607769.373746:0:14836:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97444336b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14836:1869199364420992:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782607769.373833:0:14836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607769.374056:0:14836:0:(client.c:2701:ptlrpc_set_wait()) set ffff97456a83f540 going to sleep for 11 seconds 00000100:00100000:0.0:1782607769.374115:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364420992 00000100:00100000:0.0:1782607769.374120:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364420992 00000100:00100000:0.0:1782607769.374142:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1782607769.374148:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745770b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+13:14836:x1869199364420992:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782607769.374156:0:14197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607769.374164:0:14197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974546c43000/0x8109266df35cc27b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cc274 expref: -99 pid: 14197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607769.374178:0:14197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974546c43000/0x8109266df35cc27b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cc274 expref: 14 pid: 14197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607769.374187:0:14197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974546c43000/0x8109266df35cc27b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cc274 expref: 14 pid: 14197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607769.374204:0:14197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c43000, rc 0) 00000100:00100000:0.0:1782607769.374241:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745770b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+14:14836:x1869199364420992:12345-0@lo:101:mount.lustre.0 Request processed in 93us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607769.374248:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782607769.374370:0:14836:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97444336b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14836:1869199364420992:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782607769.374389:0:14836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff97455d648200/0x8109266df35cc274 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc27b expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607769.374397:0:14836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff97455d648200/0x8109266df35cc274 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cc27b expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782607769.375051:0:14836:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1782607769.375840:0:14836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782607769.376096:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1782607769.376139:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1782607769.376173:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1782607769.376221:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1782607769.376259:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1782607769.376292:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1782607769.376365:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1782607769.376384:0:14836:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1782607769.376453:0:14836:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97444336b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14836:1869199364421120:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782607769.376510:0:14836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607769.376545:0:14836:0:(client.c:2701:ptlrpc_set_wait()) set ffff97456a83fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1782607769.376815:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364421120 00000100:00100000:0.0:1782607769.376822:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364421120 00000100:00100000:0.0:1782607769.376868:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1782607769.376876:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f5a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+14:14836:x1869199364421120:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782607769.377190:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f5a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+14:14836:x1869199364421120:12345-0@lo:501:mount.lustre.0 Request processed in 313us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607769.377197:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782607769.377500:0:14836:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97444336b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14836:1869199364421120:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782607769.377540:0:14836:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97444336b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14836:1869199364421248:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782607769.377579:0:14836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607769.377639:0:14836:0:(client.c:2701:ptlrpc_set_wait()) set ffff97456a83fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1782607769.377686:0:14199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364421248 00000100:00100000:1.0:1782607769.377690:0:14199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364421248 00000100:00100000:0.0:1782607769.377729:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1782607769.377736:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f5a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+14:14836:x1869199364421248:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782607769.378122:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f5a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+14:14836:x1869199364421248:12345-0@lo:503:mount.lustre.0 Request processed in 386us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607769.378128:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782607769.378238:0:14836:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97444336b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14836:1869199364421248:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1782607769.379068:0:14836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782607769.379118:0:14836:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97444336b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14836:1869199364421376:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782607769.379151:0:14836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607769.379211:0:14836:0:(client.c:2701:ptlrpc_set_wait()) set ffff97456a83fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1782607769.379239:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364421376 00000100:00100000:0.0:1782607769.379242:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364421376 00000100:00100000:0.0:1782607769.379344:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1782607769.379352:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f5a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+14:14836:x1869199364421376:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782607769.379501:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f5a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+14:14836:x1869199364421376:12345-0@lo:502:mount.lustre.0 Request processed in 150us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607769.379506:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782607769.379566:0:14836:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97444336b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14836:1869199364421376:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782607769.379730:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1782607769.379757:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1782607769.379793:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1782607769.379818:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1782607769.379836:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1782607769.379862:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1782607769.379886:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1782607769.379903:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1782607769.379918:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1782607769.379939:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1782607769.379956:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1782607769.379987:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1782607769.380009:0:14836:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97444336b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14836:1869199364421504:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782607769.380045:0:14836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607769.380234:0:14836:0:(client.c:2701:ptlrpc_set_wait()) set ffff97456a83fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1782607769.380394:0:14199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364421504 00000100:00100000:1.0:1782607769.380405:0:14199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364421504 00000100:00100000:1.0:1782607769.380430:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1782607769.380438:0:14199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f5a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+14:14836:x1869199364421504:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782607769.380591:0:14199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f5a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+14:14836:x1869199364421504:12345-0@lo:502:mount.lustre.0 Request processed in 153us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607769.380598:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782607769.380681:0:14836:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97444336b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14836:1869199364421504:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782607769.380745:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1782607769.380754:0:14836:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1782607769.381636:0:14850:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1782607769.381645:0:14850:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1782607769.381651:0:14850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782607769.381654:0:14850:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1782607769.381660:0:14850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782607769.381676:0:14850:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9745815099c0) 00000020:00000080:1.0:1782607769.381706:0:14850:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1782607769.381713:0:14850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1782607769.381808:0:14850:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97454a72d000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1782607769.381814:0:14850:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1782607769.381821:0:14850:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8109266df35cc289 00010000:00010000:1.0:1782607769.384804:0:14850:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1782607769.385312:0:14850:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1782607769.387231:0:14850:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1782607769.388295:0:14850:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1782607769.388303:0:14850:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782607769.388307:0:14850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782607769.388309:0:14850:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1782607769.388311:0:14850:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1782607769.388313:0:14850:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1782607769.388315:0:14850:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782607769.388316:0:14850:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782607769.388318:0:14850:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1782607769.388320:0:14850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782607769.388322:0:14850:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1782607769.388331:0:14850:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782607769.388334:0:14850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782607769.388336:0:14850:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1782607769.388339:0:14850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782607769.388341:0:14850:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1782607769.388343:0:14850:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782607769.388345:0:14850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782607769.388346:0:14850:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1782607769.388349:0:14850:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782607769.388351:0:14850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782607769.388352:0:14850:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1782607769.388355:0:14850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1782607769.388409:0:14850:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782607769.388413:0:14850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782607769.388415:0:14850:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1782607769.388418:0:14850:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1782607769.388590:0:14836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1782607769.388615:0:14836:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1782607769.388632:0:14836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97455d648200/0x8109266df35cc274 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc27b expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607769.388641:0:14836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff97455d648200/0x8109266df35cc274 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc27b expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782607769.388647:0:14836:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff97454a72d000 from 1 10000000:01000000:3.0:1782607769.388648:0:14836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782607769.388676:0:14836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97455d649e00/0x8109266df35cc290 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607769.388682:0:14836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff97455d649e00/0x8109266df35cc290 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607769.388690:0:14836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff97455d649e00/0x8109266df35cc290 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607769.388709:0:14836:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97444336b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14836:1869199364421632:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782607769.388785:0:14836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607769.388818:0:14836:0:(client.c:2701:ptlrpc_set_wait()) set ffff97456a83f000 going to sleep for 11 seconds 00000100:00100000:2.0:1782607769.388939:0:14199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364421632 00000100:00100000:2.0:1782607769.388945:0:14199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364421632 00000100:00100000:2.0:1782607769.388983:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782607769.388990:0:14199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f5a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+14:14836:x1869199364421632:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782607769.389000:0:14199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607769.389010:0:14199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974541549a00/0x8109266df35cc297 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cc290 expref: -99 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607769.389027:0:14199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974541549a00/0x8109266df35cc297 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cc290 expref: 15 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607769.389041:0:14199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974541549a00/0x8109266df35cc297 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cc290 expref: 15 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607769.389048:0:14199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974541549a00, rc 0) 00000100:00100000:2.0:1782607769.389110:0:14199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f5a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+15:14836:x1869199364421632:12345-0@lo:101:mount.lustre.0 Request processed in 120us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607769.389115:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1782607769.389188:0:14836:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97444336b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14836:1869199364421632:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782607769.389202:0:14836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff97455d649e00/0x8109266df35cc290 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc297 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607769.389208:0:14836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff97455d649e00/0x8109266df35cc290 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cc297 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782607769.389649:0:14836:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1782607769.392601:0:14836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782607769.393488:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1782607769.393527:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1782607769.393588:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1782607769.393594:0:14836:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1782607769.393677:0:14836:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97444336b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14836:1869199364421760:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782607769.393731:0:14836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607769.394245:0:14836:0:(client.c:2701:ptlrpc_set_wait()) set ffff97456a83f000 going to sleep for 11 seconds 00000100:00100000:2.0:1782607769.394321:0:14198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364421760 00000100:00100000:2.0:1782607769.394328:0:14198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364421760 00000100:00100000:2.0:1782607769.394388:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1782607769.394399:0:14198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f5a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+15:14836:x1869199364421760:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782607769.394618:0:14198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f5a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+15:14836:x1869199364421760:12345-0@lo:501:mount.lustre.0 Request processed in 222us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607769.394624:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1782607769.394717:0:14836:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97444336b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14836:1869199364421760:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782607769.394758:0:14836:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974549e7df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14836:1869199364421888:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782607769.394821:0:14836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607769.394843:0:14836:0:(client.c:2701:ptlrpc_set_wait()) set ffff974577a59c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782607769.394921:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364421888 00000100:00100000:3.0:1782607769.394924:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364421888 00000100:00100000:3.0:1782607769.394942:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782607769.394946:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f5a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+15:14836:x1869199364421888:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782607769.395047:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f5a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+15:14836:x1869199364421888:12345-0@lo:503:mount.lustre.0 Request processed in 100us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607769.395051:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1782607769.395132:0:14836:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974549e7df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14836:1869199364421888:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1782607769.395681:0:14836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782607769.395735:0:14836:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974549e7df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14836:1869199364422016:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782607769.395794:0:14836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607769.395814:0:14836:0:(client.c:2701:ptlrpc_set_wait()) set ffff974577a59c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782607769.395927:0:14199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364422016 00000100:00100000:3.0:1782607769.395931:0:14199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364422016 00000100:00100000:3.0:1782607769.395957:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782607769.395962:0:14199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f5a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+15:14836:x1869199364422016:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782607769.396058:0:14199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f5a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+15:14836:x1869199364422016:12345-0@lo:502:mount.lustre.0 Request processed in 96us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607769.396069:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1782607769.396169:0:14836:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974549e7df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14836:1869199364422016:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782607769.396434:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1782607769.396480:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1782607769.396530:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1782607769.396566:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1782607769.396595:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1782607769.396622:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1782607769.396651:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1782607769.396667:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1782607769.396683:0:14836:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974549e7df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14836:1869199364422144:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782607769.396708:0:14836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607769.396733:0:14836:0:(client.c:2701:ptlrpc_set_wait()) set ffff974577a59c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782607769.396784:0:14198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364422144 00000100:00100000:3.0:1782607769.396788:0:14198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364422144 00000100:00100000:3.0:1782607769.396840:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1782607769.396921:0:14198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f5a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+15:14836:x1869199364422144:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782607769.397021:0:14198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f5a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+15:14836:x1869199364422144:12345-0@lo:502:mount.lustre.0 Request processed in 177us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607769.397027:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1782607769.397074:0:14836:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974549e7df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14836:1869199364422144:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782607769.397127:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1782607769.397133:0:14836:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1782607769.397604:0:14854:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782607769.397611:0:14854:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782607769.397613:0:14854:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1782607769.397622:0:14854:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff97454a72d000 00000020:00000080:0.0:1782607769.397624:0:14854:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782607769.397629:0:14854:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782607769.397631:0:14854:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782607769.397632:0:14854:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1782607769.397633:0:14854:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782607769.397635:0:14854:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782607769.397635:0:14854:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1782607769.397637:0:14854:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff97454a72d000 00000020:00000080:0.0:1782607769.397638:0:14854:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782607769.397682:0:14854:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782607769.400831:0:14854:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782607769.400838:0:14854:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1782607769.400856:0:14854:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782607769.400862:0:14854:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782607769.400864:0:14854:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1782607769.400869:0:14854:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97454a72d000 00000020:00000080:1.0:1782607769.400872:0:14854:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782607769.400966:0:14854:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782607769.400970:0:14854:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782607769.400971:0:14854:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1782607769.400974:0:14854:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1782607769.404727:0:14836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1782607769.406959:0:14836:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782607769.406990:0:14836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97455d649e00/0x8109266df35cc290 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc297 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607769.407003:0:14836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff97455d649e00/0x8109266df35cc290 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc297 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782607769.407051:0:14836:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1782607769.407053:0:14836:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97454a72d000 10000000:01000000:0.0:1782607769.407055:0:14836:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97454a72d000 10000000:01000000:0.0:1782607769.407058:0:14836:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1782607769.407062:0:14836:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff97454a72d000 from 1 10000000:01000000:0.0:1782607769.407064:0:14836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782607769.407093:0:14836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974546c43e00/0x8109266df35cc29e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607769.407099:0:14836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974546c43e00/0x8109266df35cc29e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607769.407107:0:14836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974546c43e00/0x8109266df35cc29e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607769.407131:0:14836:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974549e7df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14836:1869199364422272:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1782607769.407185:0:14836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607769.407220:0:14836:0:(client.c:2701:ptlrpc_set_wait()) set ffff974544276c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782607769.407934:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364422272 00000100:00100000:3.0:1782607769.407941:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364422272 00000100:00100000:3.0:1782607769.407982:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1782607769.407988:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f5a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+15:14836:x1869199364422272:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782607769.408002:0:14197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607769.408014:0:14197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97455d649c00/0x8109266df35cc2a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cc29e expref: -99 pid: 14197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607769.408035:0:14197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97455d649c00/0x8109266df35cc2a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cc29e expref: 16 pid: 14197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607769.408043:0:14197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97455d649c00/0x8109266df35cc2a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cc29e expref: 16 pid: 14197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607769.408051:0:14197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97455d649c00, rc 0) 00000100:00100000:3.0:1782607769.408940:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f5a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+16:14836:x1869199364422272:12345-0@lo:101:mount.lustre.0 Request processed in 947us (1750us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607769.408947:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1782607769.412391:0:14836:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974549e7df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14836:1869199364422272:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782607769.412423:0:14836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974546c43e00/0x8109266df35cc29e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc2a5 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607769.412437:0:14836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974546c43e00/0x8109266df35cc29e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cc2a5 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782607769.414678:0:14836:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1782607769.416162:0:14836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782607769.417593:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1782607769.417651:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1782607769.417687:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1782607769.417730:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1782607769.418334:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1782607769.418419:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1782607769.418457:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1782607769.418488:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1782607769.418534:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1782607769.418569:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1782607769.418620:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1782607769.418671:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1782607769.418708:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1782607769.418742:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1782607769.419973:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1782607769.420030:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1782607769.420063:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1782607769.420125:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1782607769.420162:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1782607769.420195:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1782607769.420246:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1782607769.421090:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1782607769.421131:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1782607769.421191:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1782607769.421228:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1782607769.423106:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1782607769.423224:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1782607769.423270:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1782607769.423360:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1782607769.423367:0:14836:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1782607769.423479:0:14836:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457760b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14836:1869199364422400:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782607769.423545:0:14836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607769.424037:0:14836:0:(client.c:2701:ptlrpc_set_wait()) set ffff97457f927a80 going to sleep for 11 seconds 00000100:00100000:3.0:1782607769.424204:0:14198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364422400 00000100:00100000:3.0:1782607769.424221:0:14198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364422400 00000100:00100000:3.0:1782607769.424355:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1782607769.424365:0:14198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f5a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+16:14836:x1869199364422400:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782607769.424640:0:14198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f5a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+16:14836:x1869199364422400:12345-0@lo:501:mount.lustre.0 Request processed in 276us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607769.424648:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1782607769.424717:0:14836:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457760b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14836:1869199364422400:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782607769.424754:0:14836:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457760b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14836:1869199364422528:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782607769.424823:0:14836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607769.425028:0:14836:0:(client.c:2701:ptlrpc_set_wait()) set ffff97457f927a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782607769.425087:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364422528 00000100:00100000:0.0:1782607769.425093:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364422528 00000100:00100000:0.0:1782607769.425117:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1782607769.425124:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f5a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+16:14836:x1869199364422528:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782607769.425273:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f5a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+16:14836:x1869199364422528:12345-0@lo:503:mount.lustre.0 Request processed in 150us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607769.425280:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1782607769.425402:0:14836:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457760b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14836:1869199364422528:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1782607769.425991:0:14836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782607769.426079:0:14836:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457760b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14836:1869199364422656:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782607769.426124:0:14836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607769.426146:0:14836:0:(client.c:2701:ptlrpc_set_wait()) set ffff97457f927a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782607769.426344:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364422656 00000100:00100000:0.0:1782607769.426349:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364422656 00000100:00100000:0.0:1782607769.426382:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1782607769.426390:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f5a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+16:14836:x1869199364422656:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782607769.426568:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f5a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+16:14836:x1869199364422656:12345-0@lo:502:mount.lustre.0 Request processed in 179us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607769.426576:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1782607769.426649:0:14836:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457760b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14836:1869199364422656:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1782607769.426959:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1782607769.427018:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1782607769.427052:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1782607769.427097:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1782607769.427130:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1782607769.427175:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1782607769.427210:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1782607769.427242:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1782607769.428004:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1782607769.428042:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1782607769.428073:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1782607769.428116:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1782607769.428151:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1782607769.428184:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1782607769.428231:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1782607769.429049:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1782607769.429102:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1782607769.429173:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1782607769.429209:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1782607769.429240:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1782607769.430123:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1782607769.430164:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1782607769.430193:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1782607769.430235:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1782607769.430282:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1782607769.430314:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1782607769.430359:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1782607769.430404:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1782607769.430432:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1782607769.430476:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1782607769.430505:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1782607769.430532:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1782607769.430561:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1782607769.430603:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1782607769.430638:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1782607769.430704:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1782607769.430739:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1782607769.430806:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1782607769.431043:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1782607769.431085:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1782607769.431137:0:14836:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974443368e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14836:1869199364422784:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782607769.431217:0:14836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607769.431307:0:14836:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745509bf000 going to sleep for 11 seconds 00000100:00100000:1.0:1782607769.431392:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364422784 00000100:00100000:1.0:1782607769.431400:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364422784 00000100:00100000:1.0:1782607769.431454:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1782607769.431464:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f5a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+16:14836:x1869199364422784:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782607769.431755:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f5a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+16:14836:x1869199364422784:12345-0@lo:502:mount.lustre.0 Request processed in 291us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607769.431799:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1782607769.433487:0:14836:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974443368e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14836:1869199364422784:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1782607769.433627:0:14836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1782607769.433648:0:14836:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1782607769.434951:0:14858:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1782607769.434966:0:14858:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff97458150b380) 00000020:00000080:1.0:1782607769.434988:0:14858:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1782607769.435146:0:14858:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97454a72d000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1782607769.435151:0:14858:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97454a72d000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1782607769.435153:0:14858:0:(obd_mount.c:701:lustre_put_lsi()) put ffff97454a72d000 3 00010000:00080000:1.0:1782607769.435178:0:14858:0:(ldlm_lib.c:102:import_set_conn()) imp ffff974544155000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.104@tcp at head 00010000:00010000:1.0:1782607769.437150:0:14858:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1782607769.438937:0:14858:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1782607769.438994:0:14858:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1782607769.439024:0:14858:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x8109266df35cc2b3 00000100:00080000:1.0:1782607769.439037:0:14858:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782607769.439043:0:14858:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff974544155000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1782607769.439077:0:14858:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97457f40f800 x1869199364422912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782607769.439118:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3315:1869199364422912:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1782607769.439185:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607769.439248:0:14204:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364422912 00000100:00100000:1.0:1782607769.439503:0:14204:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364422912 00000100:00100000:1.0:1782607769.439571:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782607769.439578:0:14204:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f40e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3315:x1869199364422912:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1782607769.439599:0:14204:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 428 last 0 00000020:00000080:1.0:1782607769.439640:0:14204:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x8109266df35cc2ba 00000004:00100000:1.0:1782607769.439654:0:14204:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1782607769.439681:0:14204:0:(import.c:65:import_set_state_nolock()) ffff974577e36800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782607769.439741:0:14204:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f40e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869199364422912:12345-0@lo:38:llog_process_th.0 Request processed in 162us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607769.439749:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1782607769.439960:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97457f40f800 x1869199364422912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782607779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782607769.439971:0:3315:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782607769.439979:0:3315:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1782607769.439986:0:3315:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1782607769.439990:0:3315:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1782607769.439992:0:3315:0:(import.c:65:import_set_state_nolock()) ffff974544155000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1782607769.439997:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3315:1869199364422912:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1782607769.440982:0:14858:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1782607769.441547:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782607769.441558:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782607769.441561:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782607769.441563:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1782607769.441627:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974443368700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1869199364423040:0@lo:400:kworker.0 00000100:00100000:3.0:1782607769.441680:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607769.441730:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364423040 00000100:00100000:3.0:1782607769.441737:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364423040 00000100:00100000:3.0:1782607769.441791:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782607769.441799:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1869199364423040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607769.441843:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1869199364423040:12345-0@lo:400:kworker.0 Request processed in 44us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607769.441862:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1782607769.441899:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff974443368700 x1869199364423040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782607785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607769.441912:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974443368700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1869199364423040:0@lo:400:kworker.0 00000040:00080000:3.0:1782607769.444320:0:14858:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1782607769.444447:0:14836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1782607769.444476:0:14836:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782607769.444491:0:14836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974546c43e00/0x8109266df35cc29e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc2a5 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607769.444502:0:14836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974546c43e00/0x8109266df35cc29e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc2a5 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1782607769.444546:0:14836:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1782607769.444549:0:14836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1782607769.444550:0:14836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782607769.444551:0:14836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782607769.444552:0:14836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782607769.444553:0:14836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782607769.444554:0:14836:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782607769.444556:0:14836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782607769.444558:0:14836:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1782607769.444561:0:14836:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1782607769.444564:0:14836:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1782607769.444565:0:14836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1782607769.444566:0:14836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782607769.444567:0:14836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782607769.444568:0:14836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782607769.444569:0:14836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782607769.444570:0:14836:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782607769.444572:0:14836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782607769.444573:0:14836:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1782607769.444596:0:14836:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1782607769.444614:0:14836:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14836:1869199364423168:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1782607769.444678:0:14836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607769.444717:0:14836:0:(client.c:2701:ptlrpc_set_wait()) set ffff97456a83f540 going to sleep for 11 seconds 00000100:00100000:3.0:1782607769.444791:0:14199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364423168 00000100:00100000:3.0:1782607769.444798:0:14199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364423168 00000100:00100000:3.0:1782607769.444833:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782607769.444841:0:14199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+16:14836:x1869199364423168:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1782607769.444928:0:14199:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1782607769.444941:0:14199:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1782607769.471366:0:14199:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1782607769.471422:0:14199:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1782607769.473819:0:14220:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1782607769.473829:0:14220:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1782607769.473965:0:14220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9745585adc00/0x8109266df35cc2c1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607769.473987:0:14220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff974546c42200/0x8109266df35cc22e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cc227 expref: 16 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607769.473997:0:14220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9745585adc00/0x8109266df35cc2c1 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607769.474044:0:14220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff974546c42200/0x8109266df35cc22e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8109266df35cc227 expref: 16 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607769.474061:0:14220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff974546c42200/0x8109266df35cc22e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8109266df35cc227 expref: 16 pid: 14199 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607769.474078:0:14220:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457760b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14220:1869199364423296:0@lo:104: 00000100:00100000:2.0:1782607769.474150:0:14220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607769.474217:0:14220:0:(client.c:2701:ptlrpc_set_wait()) set ffff97457f927b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782607769.474294:0:14187:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364423296 00000100:00100000:3.0:1782607769.474306:0:14187:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364423296 00000100:00100000:3.0:1782607769.474355:0:14187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782607769.474365:0:14187:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974577609f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:33f55b46-a882-437e-a0a1-2be6832a7ec1+3:14220:x1869199364423296:12345-0@lo:104: 00010000:00010000:3.0:1782607769.474387:0:14187:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff974541548e00/0x8109266df35cc227 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cc22e expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607769.474445:0:14187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782607769.474452:0:14187:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974577609f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:33f55b46-a882-437e-a0a1-2be6832a7ec1+3:14220:x1869199364423296:12345-0@lo:104: Request processed in 89us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607769.474458:0:14187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782607769.475438:0:14220:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457760b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14220:1869199364423296:0@lo:104: 00010000:00010000:2.0:1782607769.475461:0:14220:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9745585adc00/0x8109266df35cc2c1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607769.476000:0:14193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782607769.476009:0:14193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974541548e00/0x8109266df35cc227 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cc22e expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607769.476017:0:14193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974541548e00 already unused, calling callback (ffffffffc1db0c20) 10000000:00010000:0.0:1782607769.476021:0:14193:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974541548e00/0x8109266df35cc227 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8109266df35cc22e expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607769.476046:0:14193:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974541548e00/0x8109266df35cc227 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8109266df35cc22e expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782607769.476053:0:14193:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974541548e00/0x8109266df35cc227 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8109266df35cc22e expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782607769.476059:0:14193:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1782607769.476096:0:14193:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974541548e00/0x8109266df35cc227 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cc22e expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607769.476101:0:14193:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782607769.476120:0:14193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974541548e00/0x8109266df35cc227 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cc22e expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607769.476127:0:14193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974541548e00/0x8109266df35cc227 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cc22e expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607769.476145:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607769.476147:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607769.476149:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782607769.476229:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974549e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33f55b46-a882-437e-a0a1-2be6832a7ec1:3316:1869199364423424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782607769.476291:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607769.476350:0:14191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364423424 00000100:00100000:0.0:1782607769.476356:0:14191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364423424 00010000:00010000:0.0:1782607769.476387:0:14191:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff974546c42200/0x8109266df35cc22e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cc227 expref: 17 pid: 14199 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607769.476414:0:14191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782607769.476422:0:14191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549e7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33f55b46-a882-437e-a0a1-2be6832a7ec1+17:3316:x1869199364423424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782607769.476439:0:14191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782607769.476445:0:14191:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff974546c42200/0x8109266df35cc22e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cc227 expref: 17 pid: 14199 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607769.476456:0:14191:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff974546c42200/0x8109266df35cc22e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8109266df35cc227 expref: 17 pid: 14199 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607769.476469:0:14191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974546c42200/0x8109266df35cc22e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8109266df35cc227 expref: 17 pid: 14199 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607769.476482:0:14191:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9745585adc00/0x8109266df35cc2c1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607769.476490:0:14191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9745585adc00/0x8109266df35cc2c1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1782607769.476504:0:14191:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002675459s 00010000:00010000:0.0:1782607769.476508:0:14191:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9745585adc00/0x8109266df35cc2c1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607769.476515:0:14191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9745585adc00/0x8109266df35cc2c1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607769.476521:0:14191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9745585adc00/0x8109266df35cc2c1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607769.476527:0:14191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9745585adc00/0x8109266df35cc2c1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607769.476533:0:14191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585adc00 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:0.0:1782607769.476536:0:14191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9745585adc00/0x8109266df35cc2c1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607769.476548:0:14191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9745585adc00/0x8109266df35cc2c1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607769.476562:0:14191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9745585adc00/0x8109266df35cc2c1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607769.476570:0:14191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782607769.476601:0:14191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549e7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33f55b46-a882-437e-a0a1-2be6832a7ec1+16:3316:x1869199364423424:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607769.476608:0:14191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1782607769.476630:0:14220:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9745585adc00/0x8109266df35cc2c1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607769.476638:0:14220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9745585adc00/0x8109266df35cc2c1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607769.476643:0:14220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9745585adc00/0x8109266df35cc2c1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607769.476669:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974549e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33f55b46-a882-437e-a0a1-2be6832a7ec1:3316:1869199364423424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782607769.479527:0:14199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+15:14836:x1869199364423168:12345-0@lo:253:mount.lustre.0 Request processed in 34676us (34840us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607769.479541:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1782607769.479618:0:14836:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:14836:1869199364423168:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1782607769.479634:0:14836:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1782607769.479638:0:14836:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1782607769.479639:0:14836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1782607769.479640:0:14836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782607769.479642:0:14836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782607769.479643:0:14836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782607769.479644:0:14836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782607769.479646:0:14836:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782607769.479648:0:14836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782607769.479650:0:14836:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1782607769.479665:0:14836:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1782607769.484175:0:14836:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1782607769.484423:0:14836:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1782607769.484578:0:14836:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1782607769.484724:0:14836:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1782607769.484987:0:14836:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1782607769.485199:0:14836:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1782607769.486088:0:14836:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1782607769.537229:0:14836:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1782607769.537238:0:14836:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1782607769.537332:0:14836:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1782607769.537410:0:14836:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.104@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1782607769.537423:0:14836:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1782607769.537451:0:14836:0:(super25.c:188:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1782607769.604804:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607770.626003:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782607770.818005:0:14201:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1782607770.818011:0:14201:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9745812ef000 from 7 10000000:01000000:0.0:1782607770.818015:0:14201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1782607770.818066:0:14201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974546c42200/0x8109266df35cc2c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607770.818095:0:14201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974546c42200/0x8109266df35cc2c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607770.818106:0:14201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974546c42200/0x8109266df35cc2c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607770.818131:0:14201:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974549e7df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33f55b46-a882-437e-a0a1-2be6832a7ec1:14201:1869199364423552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782607770.818207:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607770.818381:0:14201:0:(client.c:2701:ptlrpc_set_wait()) set ffff974579979600 going to sleep for 11 seconds 00000100:00100000:2.0:1782607770.819035:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364423552 00000100:00100000:2.0:1782607770.819044:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364423552 00000100:00100000:2.0:1782607770.819131:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1782607770.819141:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+15:14201:x1869199364423552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782607770.819155:0:14197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607770.819173:0:14197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9745585ac600/0x8109266df35cc2cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cc2c8 expref: -99 pid: 14197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607770.819197:0:14197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9745585ac600/0x8109266df35cc2cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cc2c8 expref: 16 pid: 14197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607770.819209:0:14197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9745585ac600/0x8109266df35cc2cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cc2c8 expref: 16 pid: 14197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607770.819228:0:14197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585ac600, rc 0) 00000100:00100000:2.0:1782607770.819624:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+16:14201:x1869199364423552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 483us (1416us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607770.819632:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1782607770.820545:0:14201:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974549e7df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33f55b46-a882-437e-a0a1-2be6832a7ec1:14201:1869199364423552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782607770.820569:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974546c42200/0x8109266df35cc2c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc2cf expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607770.820579:0:14201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974546c42200/0x8109266df35cc2c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cc2cf expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607770.820656:0:14201:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33f55b46-a882-437e-a0a1-2be6832a7ec1:14201:1869199364423680:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1782607770.820704:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607770.821471:0:14201:0:(client.c:2701:ptlrpc_set_wait()) set ffff97457f49e540 going to sleep for 11 seconds 00000100:00100000:0.0:1782607770.821512:0:14198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364423680 00000100:00100000:0.0:1782607770.821519:0:14198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364423680 00000100:00100000:0.0:1782607770.821559:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1782607770.821567:0:14198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+16:14201:x1869199364423680:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1782607770.821589:0:14198:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1782607770.821607:0:14198:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1782607770.821609:0:14198:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1782607770.821703:0:14198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+16:14201:x1869199364423680:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 136us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607770.821711:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1782607770.822070:0:14201:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33f55b46-a882-437e-a0a1-2be6832a7ec1:14201:1869199364423680:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1782607770.822140:0:14201:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1782607770.822148:0:14201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974546c42200/0x8109266df35cc2c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc2cf expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607770.822159:0:14201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974546c42200/0x8109266df35cc2c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc2cf expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607771.653608:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607772.676105:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607773.698322:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607774.725883:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782607774.789066:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782607774.789073:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1782607774.789076:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782607774.789079:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1782607774.789271:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782607774.789306:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974549e7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33f55b46-a882-437e-a0a1-2be6832a7ec1:3316:1869199364423808:0@lo:400:kworker.0 00000100:00100000:0.0:1782607774.789404:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607774.789461:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974549e7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1869199364423936:0@lo:400:kworker.0 00000100:00100000:0.0:1782607774.789501:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607774.789527:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782607774.789533:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974549e7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1869199364424064:0@lo:400:kworker.0 00000100:00100000:0.0:1782607774.789558:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607774.789591:0:14198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364423808 00000100:00100000:0.0:1782607774.789600:0:14198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364423808 00000100:00100000:0.0:1782607774.789659:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1782607774.789668:0:14198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+16:3316:x1869199364423808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607774.789720:0:14198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+16:3316:x1869199364423808:12345-0@lo:400:kworker.0 Request processed in 53us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607774.789728:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1782607774.789788:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364423936 00000100:00100000:0.0:1782607774.789792:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364423936 00000100:00100000:0.0:1782607774.789815:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364424064 00000100:00100000:0.0:1782607774.789818:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364424064 00000100:00100000:0.0:1782607774.789841:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782607774.789847:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549e7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1869199364423936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607774.789881:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549e7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1869199364423936:12345-0@lo:400:kworker.0 Request processed in 35us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607774.789888:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782607774.789899:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782607774.789905:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549e7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1869199364424064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607774.789930:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549e7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1869199364424064:12345-0@lo:400:kworker.0 Request processed in 26us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607774.789946:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1782607774.789988:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff974549e7e680 x1869199364424064/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782607790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782607774.790000:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974549e7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1869199364424064:0@lo:400:kworker.0 00010000:00080000:0.0:1782607774.790010:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff974549e7e300 x1869199364423936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782607790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782607774.790017:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974549e7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1869199364423936:0@lo:400:kworker.0 00000100:00100000:0.0:1782607774.790040:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974549e7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33f55b46-a882-437e-a0a1-2be6832a7ec1:3316:1869199364423808:0@lo:400:kworker.0 00000100:00080000:0.0:1782607774.792524:0:14200:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782607775.746860:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607776.779914:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782607777.266967:0:15201:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1782607777.793990:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782607778.114918:0:14236:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1782607778.818016:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607779.845899:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782607779.907760:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782607779.907805:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782607779.907808:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782607779.907824:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1782607779.907873:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457760a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869199364424320:0@lo:400:kworker.0 00000100:00100000:2.0:1782607779.907941:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607779.908003:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782607779.908009:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457760b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33f55b46-a882-437e-a0a1-2be6832a7ec1:3317:1869199364424192:0@lo:400:kworker.0 00000100:00100000:2.0:1782607779.908042:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607779.908080:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974577609180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1869199364424448:0@lo:400:kworker.0 00000100:00100000:2.0:1782607779.908103:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607779.908138:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364424320 00000100:00100000:2.0:1782607779.908145:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364424320 00000100:00100000:2.0:1782607779.908200:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364424448 00000100:00100000:2.0:1782607779.908203:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364424448 00000100:00100000:2.0:1782607779.908233:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782607779.908241:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974577608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869199364424320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607779.908302:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974577608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869199364424320:12345-0@lo:400:kworker.0 Request processed in 61us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607779.908310:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782607779.908326:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782607779.908332:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974577608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1869199364424448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607779.908361:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974577608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1869199364424448:12345-0@lo:400:kworker.0 Request processed in 30us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607779.908367:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782607779.908397:0:14199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364424192 00000100:00100000:2.0:1782607779.908401:0:14199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364424192 00000100:00100000:2.0:1782607779.908430:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782607779.908437:0:14199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+16:3317:x1869199364424192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607779.908472:0:14199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+16:3317:x1869199364424192:12345-0@lo:400:kworker.0 Request processed in 37us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607779.908479:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1782607779.908510:0:14200:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1782607779.908538:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff974577609180 x1869199364424448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782607795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782607779.908552:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974577609180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1869199364424448:0@lo:400:kworker.0 00000100:00100000:2.0:1782607779.908580:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457760b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33f55b46-a882-437e-a0a1-2be6832a7ec1:3317:1869199364424192:0@lo:400:kworker.0 00010000:00080000:2.0:1782607779.908589:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97457760a680 x1869199364424320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782607795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782607779.908596:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457760a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869199364424320:0@lo:400:kworker.0 00010000:00010000:0.0:1782607780.866143:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782607781.698850:0:3315:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782607766/real 1782607766] req@ffff974443369500 x1869199364419840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782607781 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782607781.698886:0:3315:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff974443369500 x1869199364419840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782607781 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782607781.698897:0:3315:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782607766/real 1782607766] req@ffff97444336ad80 x1869199364419968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782607781 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782607781.698908:0:3315:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97444336ad80 x1869199364419968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782607781 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1782607781.698930:0:3315:0:(import.c:65:import_set_state_nolock()) ffff97456fd51800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782607781.698952:0:3315:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1782607781.698962:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974443369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1869199364419840:0@lo:8:kworker.0 00000100:00080000:0.0:1782607781.698968:0:3315:0:(import.c:65:import_set_state_nolock()) ffff97456fd52000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782607781.698974:0:3315:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1782607781.698977:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97444336ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1869199364419968:0@lo:8:kworker.0 00000100:00080000:1.0:1782607781.699336:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782607781.699341:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1782607781.699344:0:37:0:(import.c:65:import_set_state_nolock()) ffff97456fd51800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782607781.699349:0:37:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 424 00000100:00080000:1.0:1782607781.699355:0:37:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1782607781.699362:0:37:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97456fd51800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1782607781.699384:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97457f40ea00 x1869199364424704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782607781.699396:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782607781.699400:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1782607781.699401:0:37:0:(import.c:65:import_set_state_nolock()) ffff97456fd52000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782607781.699405:0:37:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 424 00000100:00080000:1.0:1782607781.699408:0:37:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1782607781.699418:0:37:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97456fd52000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1782607781.699430:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97457f40f100 x1869199364424832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782607781.699522:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33f55b46-a882-437e-a0a1-2be6832a7ec1:3319:1869199364424576:0@lo:400:kworker.0 00000100:00100000:0.0:1782607781.699596:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607781.699673:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364424576 00000100:00100000:0.0:1782607781.699681:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364424576 00000100:00100000:0.0:1782607781.699729:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782607781.699738:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+16:3319:x1869199364424576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607781.699813:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+16:3319:x1869199364424576:12345-0@lo:400:kworker.0 Request processed in 75us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607781.699820:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782607781.699937:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33f55b46-a882-437e-a0a1-2be6832a7ec1:3319:1869199364424576:0@lo:400:kworker.0 00000100:00100000:0.0:1782607781.699958:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1869199364424704:0@lo:8:kworker.0 00000100:00100000:0.0:1782607781.699987:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607781.700250:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1869199364425088:0@lo:400:kworker.0 00000100:00100000:1.0:1782607781.700297:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607781.700320:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782607781.700326:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869199364424960:0@lo:400:kworker.0 00000100:00100000:1.0:1782607781.700351:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607781.700376:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364425088 00000100:00100000:1.0:1782607781.700379:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364425088 00000100:00100000:1.0:1782607781.700416:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364424960 00000100:00100000:1.0:1782607781.700418:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364424960 00000100:00100000:1.0:1782607781.700433:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782607781.701038:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1869199364424832:0@lo:8:kworker.0 00000100:00100000:0.0:1782607781.701077:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607781.701351:0:14838:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364424704 00000100:00100000:3.0:1782607781.701357:0:14838:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364424704 00000100:00100000:3.0:1782607781.701384:0:14838:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364424832 00000100:00100000:3.0:1782607781.701387:0:14838:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364424832 00000100:00100000:3.0:1782607781.701398:0:14838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782607781.701405:0:14838:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549e7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3315:x1869199364424704:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1782607781.701431:0:14838:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 440 last 0 00000020:00000080:3.0:1782607781.701462:0:14838:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8109266df35cc2d6 00002000:00100000:3.0:1782607781.701477:0:14838:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff97456a548800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113669 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1782607781.701482:0:14838:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1782607781.701485:0:14838:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1782607781.701526:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f40d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869199364425088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607781.701577:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f40d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869199364425088:12345-0@lo:400:kworker.0 Request processed in 1137us (1280us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607781.701584:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782607781.701600:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782607781.701605:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f40d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869199364424960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607781.701632:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f40d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869199364424960:12345-0@lo:400:kworker.0 Request processed in 26us (1279us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607781.701743:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00002000:00080000:3.0:1782607781.701837:0:14838:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1782607781.701860:0:14838:0:(import.c:65:import_set_state_nolock()) ffff97456a548000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782607781.701909:0:14838:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549e7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1869199364424704:12345-0@lo:8:kworker.0 Request processed in 503us (1921us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607781.701915:0:14838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782607781.701929:0:14838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782607781.701933:0:14838:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549e7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3315:x1869199364424832:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1782607781.701944:0:14838:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1782607781.701966:0:14838:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549e7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3315:x1869199364424832:12345-0@lo:8:kworker.0 Request processed in 31us (888us total) trans 0 rc -19/-19 00000100:00100000:3.0:1782607781.701971:0:14838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1782607781.707303:0:3315:0:(import.c:65:import_set_state_nolock()) ffff97456fd52000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782607781.707319:0:3315:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1782607781.707324:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1869199364424832:0@lo:8:kworker.0 00010000:00080000:0.0:1782607781.707346:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97457f40ea00 x1869199364424704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782607801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782607781.707358:0:3315:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782607781.707381:0:3315:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1782607781.707390:0:3315:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1782607781.707397:0:3315:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1782607781.707401:0:3315:0:(import.c:65:import_set_state_nolock()) ffff97456fd51800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1782607781.707423:0:3315:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1782607781.707429:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1869199364424704:0@lo:8:kworker.0 00000004:00080000:0.0:1782607781.707470:0:14226:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1782607781.707509:0:14227:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:2.0:1782607781.707532:0:14227:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457760b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14227:1869199364425344:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1782607781.707603:0:14227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607781.707633:0:14227:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745511a43c0 going to sleep for 11 seconds 00000004:00080000:0.0:1782607781.707951:0:14226:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 440554184642ns, next at 0ns, rc = 0 00000100:00100000:0.0:1782607781.707996:0:14840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364425344 00000100:00100000:0.0:1782607781.708003:0:14840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364425344 00000100:00100000:0.0:1782607781.708046:0:14840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782607781.708055:0:14840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974577609180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14227:x1869199364425344:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1782607781.714146:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457760a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364425216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782607781.714251:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1782607781.714789:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97457f40f480 x1869199364424960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782607797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607781.714821:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869199364424960:0@lo:400:kworker.0 00010000:00080000:1.0:1782607781.714841:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97457f40d500 x1869199364425088/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782607797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607781.714849:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1869199364425088:0@lo:400:kworker.0 00000100:00080000:1.0:1782607781.714891:0:14200:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782607781.714899:0:14200:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00080000:0.0:1782607781.715811:0:14840:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1782607781.715821:0:14840:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1782607781.715827:0:14840:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00000100:00100000:3.0:1782607781.716949:0:14841:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364425216 00000100:00100000:3.0:1782607781.716957:0:14841:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364425216 00000100:00100000:3.0:1782607781.717000:0:14841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782607781.717010:0:14841:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f40ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1869199364425216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782607781.717047:0:14841:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782607781.717125:0:14841:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f40ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1869199364425216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (2874us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607781.717132:0:14841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1782607781.717190:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97457760a680 x1869199364425216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607797 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782607781.717212:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457760a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364425216:0@lo:13:osp-pre-0-0.0 00002000:00010000:1.0:1782607781.725322:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782607781.725492:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ef4849e/0x8109266df35cc2dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.725516:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1782607781.725522:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607781.725531:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ef4849e/0x8109266df35cc2dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.725554:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ef4849e/0x8109266df35cc2dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.725565:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ef4849e/0x8109266df35cc2dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.725574:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ef4849e/0x8109266df35cc2dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.725597:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782607781.725723:0:14192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782607781.725732:0:14192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ef4849e/0x8109266df35cc2dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607781.725743:0:14192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f467600 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:2.0:1782607781.725748:0:14192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ef4849e/0x8109266df35cc2dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607781.725760:0:14192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ef4849e/0x8109266df35cc2dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607781.725802:0:14192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ef4849e/0x8109266df35cc2dd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607781.725810:0:14192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ef4849e/0x8109266df35cc2dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607781.726167:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607781.726170:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607781.726172:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782607781.727076:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782607781.727085:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f4d9497/0x8109266df35cc2e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.727098:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1782607781.727102:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607781.727107:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f4d9497/0x8109266df35cc2e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.727118:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f4d9497/0x8109266df35cc2e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.727127:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f4d9497/0x8109266df35cc2e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.727134:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f4d9497/0x8109266df35cc2e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.727170:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1782607781.727628:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782607781.727634:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009962595e/0x8109266df35cc2eb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.727643:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1782607781.727646:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607781.727651:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009962595e/0x8109266df35cc2eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.727672:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009962595e/0x8109266df35cc2eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.727680:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009962595e/0x8109266df35cc2eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.727687:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009962595e/0x8109266df35cc2eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.727706:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1782607781.728096:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782607781.728102:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a03132c/0x8109266df35cc2f2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.728110:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1782607781.728114:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607781.728118:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a03132c/0x8109266df35cc2f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.728126:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a03132c/0x8109266df35cc2f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.728134:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a03132c/0x8109266df35cc2f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.728153:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a03132c/0x8109266df35cc2f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.728161:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1782607781.728561:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782607781.728567:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000088ef696/0x8109266df35cc2f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.728576:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1782607781.728580:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607781.728583:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000088ef696/0x8109266df35cc2f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.728593:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000088ef696/0x8109266df35cc2f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.728601:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000088ef696/0x8109266df35cc2f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.728608:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000088ef696/0x8109266df35cc2f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.728615:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1782607781.729015:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782607781.729021:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b27fd35/0x8109266df35cc300 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.729034:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1782607781.729037:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607781.729041:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b27fd35/0x8109266df35cc300 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.729049:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b27fd35/0x8109266df35cc300 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.729058:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b27fd35/0x8109266df35cc300 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.729065:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b27fd35/0x8109266df35cc300 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.729073:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1782607781.729380:0:14192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1782607781.729389:0:14192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f4d9497/0x8109266df35cc2e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607781.729400:0:14192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f467400 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:2.0:1782607781.729405:0:14192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f4d9497/0x8109266df35cc2e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607781.729416:0:14192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f4d9497/0x8109266df35cc2e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607781.729436:0:14192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f4d9497/0x8109266df35cc2e4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607781.729444:0:14192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f4d9497/0x8109266df35cc2e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607781.729476:0:14192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1782607781.729480:0:14192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009962595e/0x8109266df35cc2eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607781.729486:0:14192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f466200 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:2.0:1782607781.729489:0:14192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009962595e/0x8109266df35cc2eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607781.729497:0:14192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009962595e/0x8109266df35cc2eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607781.729508:0:14192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009962595e/0x8109266df35cc2eb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607781.729515:0:14192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009962595e/0x8109266df35cc2eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607781.729525:0:14192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1782607781.729529:0:14192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a03132c/0x8109266df35cc2f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607781.729535:0:14192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f466400 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:2.0:1782607781.729539:0:14192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a03132c/0x8109266df35cc2f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607781.729558:0:14192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a03132c/0x8109266df35cc2f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607781.729568:0:14192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a03132c/0x8109266df35cc2f2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607781.729576:0:14192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a03132c/0x8109266df35cc2f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607781.729588:0:14192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782607781.729591:0:14192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000088ef696/0x8109266df35cc2f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607781.729598:0:14192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f467e00 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:2.0:1782607781.729601:0:14192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000088ef696/0x8109266df35cc2f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607781.729609:0:14192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000088ef696/0x8109266df35cc2f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607781.729617:0:14192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000088ef696/0x8109266df35cc2f9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607781.729625:0:14192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000088ef696/0x8109266df35cc2f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607781.729661:0:14192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782607781.729664:0:14192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b27fd35/0x8109266df35cc300 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607781.729670:0:14192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f467200 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:2.0:1782607781.729673:0:14192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b27fd35/0x8109266df35cc300 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607781.729682:0:14192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b27fd35/0x8109266df35cc300 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607781.729693:0:14192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b27fd35/0x8109266df35cc300 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607781.729702:0:14192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b27fd35/0x8109266df35cc300 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607781.729713:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607781.729715:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607781.729717:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607781.730439:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782607781.731815:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782607781.731827:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014ff99c1/0x8109266df35cc307 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.731844:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1782607781.731848:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607781.731855:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014ff99c1/0x8109266df35cc307 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.731867:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014ff99c1/0x8109266df35cc307 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.731887:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014ff99c1/0x8109266df35cc307 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.731894:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014ff99c1/0x8109266df35cc307 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.731915:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1782607781.732706:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782607781.732712:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060a7c081/0x8109266df35cc30e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.732723:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1782607781.732727:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607781.732731:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060a7c081/0x8109266df35cc30e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.732740:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060a7c081/0x8109266df35cc30e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.732748:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060a7c081/0x8109266df35cc30e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.732755:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060a7c081/0x8109266df35cc30e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.732900:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1782607781.733317:0:14192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782607781.733325:0:14192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014ff99c1/0x8109266df35cc307 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.733333:0:14192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f466c00 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:0.0:1782607781.733348:0:14192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014ff99c1/0x8109266df35cc307 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.733357:0:14192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014ff99c1/0x8109266df35cc307 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.733386:0:14192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014ff99c1/0x8109266df35cc307 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.733393:0:14192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014ff99c1/0x8109266df35cc307 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.733413:0:14192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782607781.733416:0:14192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060a7c081/0x8109266df35cc30e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.733423:0:14192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f466000 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:0.0:1782607781.733435:0:14192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060a7c081/0x8109266df35cc30e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.733442:0:14192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060a7c081/0x8109266df35cc30e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.733452:0:14192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060a7c081/0x8109266df35cc30e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.733459:0:14192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060a7c081/0x8109266df35cc30e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.733470:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607781.733472:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607781.733479:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607781.733487:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782607781.733823:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782607781.733830:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009349a0c2/0x8109266df35cc315 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.733840:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1782607781.733843:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607781.733848:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009349a0c2/0x8109266df35cc315 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.733858:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009349a0c2/0x8109266df35cc315 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.733866:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009349a0c2/0x8109266df35cc315 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.733873:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009349a0c2/0x8109266df35cc315 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.733888:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1782607781.735075:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782607781.735085:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000056eb072/0x8109266df35cc31c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.735096:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1782607781.735106:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607781.735111:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000056eb072/0x8109266df35cc31c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.735123:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000056eb072/0x8109266df35cc31c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.735133:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000056eb072/0x8109266df35cc31c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.735140:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000056eb072/0x8109266df35cc31c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.735341:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1782607781.735894:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782607781.735900:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096c28144/0x8109266df35cc323 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.735910:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1782607781.735913:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607781.735917:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096c28144/0x8109266df35cc323 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.735927:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096c28144/0x8109266df35cc323 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.735936:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096c28144/0x8109266df35cc323 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.735950:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096c28144/0x8109266df35cc323 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.738318:0:14192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782607781.738333:0:14192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009349a0c2/0x8109266df35cc315 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.738349:0:14192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f467000 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:0.0:1782607781.738355:0:14192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009349a0c2/0x8109266df35cc315 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.738366:0:14192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009349a0c2/0x8109266df35cc315 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.738390:0:14192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009349a0c2/0x8109266df35cc315 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.738399:0:14192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009349a0c2/0x8109266df35cc315 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.738501:0:14192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782607781.738506:0:14192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000056eb072/0x8109266df35cc31c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.738513:0:14192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f466800 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:0.0:1782607781.738516:0:14192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000056eb072/0x8109266df35cc31c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.738537:0:14192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000056eb072/0x8109266df35cc31c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.738547:0:14192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000056eb072/0x8109266df35cc31c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.738554:0:14192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000056eb072/0x8109266df35cc31c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.738568:0:14192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782607781.738571:0:14192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096c28144/0x8109266df35cc323 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.738577:0:14192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f466600 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:0.0:1782607781.738580:0:14192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096c28144/0x8109266df35cc323 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.738586:0:14192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096c28144/0x8109266df35cc323 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.738594:0:14192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096c28144/0x8109266df35cc323 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.738601:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607781.738602:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607781.738611:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607781.738619:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607781.750171:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1782607781.750189:0:14840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096c28144/0x8109266df35cc323 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782607781.750949:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782607781.750958:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013ff735a/0x8109266df35cc32a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.750974:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1782607781.750978:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607781.750984:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013ff735a/0x8109266df35cc32a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.751000:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013ff735a/0x8109266df35cc32a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.751011:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013ff735a/0x8109266df35cc32a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.751018:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013ff735a/0x8109266df35cc32a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.751052:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1782607781.751445:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782607781.751451:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2c31efd/0x8109266df35cc331 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.751458:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1782607781.751462:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607781.751465:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2c31efd/0x8109266df35cc331 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.751473:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2c31efd/0x8109266df35cc331 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.751481:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2c31efd/0x8109266df35cc331 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.751490:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2c31efd/0x8109266df35cc331 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.751498:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1782607781.751903:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782607781.751909:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9fe074e/0x8109266df35cc338 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.751917:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1782607781.751926:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607781.751930:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9fe074e/0x8109266df35cc338 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.751939:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9fe074e/0x8109266df35cc338 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.751946:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9fe074e/0x8109266df35cc338 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.751952:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9fe074e/0x8109266df35cc338 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.751959:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1782607781.752354:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782607781.752360:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9d8e38f/0x8109266df35cc33f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.752368:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1782607781.752371:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607781.752374:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9d8e38f/0x8109266df35cc33f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.752384:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9d8e38f/0x8109266df35cc33f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.752392:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9d8e38f/0x8109266df35cc33f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.752404:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9d8e38f/0x8109266df35cc33f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.752412:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1782607781.752796:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782607781.752802:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2933bad/0x8109266df35cc346 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.752812:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1782607781.752815:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607781.752818:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2933bad/0x8109266df35cc346 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.752826:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2933bad/0x8109266df35cc346 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.752833:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2933bad/0x8109266df35cc346 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.752840:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2933bad/0x8109266df35cc346 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.752846:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:0.0:1782607781.753826:0:14192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1782607781.753837:0:14192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013ff735a/0x8109266df35cc32a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.753849:0:14192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f466a00 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:0.0:1782607781.753854:0:14192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013ff735a/0x8109266df35cc32a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.753865:0:14192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013ff735a/0x8109266df35cc32a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.753887:0:14192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013ff735a/0x8109266df35cc32a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.753894:0:14192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013ff735a/0x8109266df35cc32a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.753917:0:14192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1782607781.753921:0:14192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2c31efd/0x8109266df35cc331 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.753927:0:14192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97457f467800 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:0.0:1782607781.753930:0:14192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2c31efd/0x8109266df35cc331 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.753955:0:14192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2c31efd/0x8109266df35cc331 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.753966:0:14192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2c31efd/0x8109266df35cc331 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.753973:0:14192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2c31efd/0x8109266df35cc331 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.753988:0:14192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782607781.753992:0:14192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9fe074e/0x8109266df35cc338 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.753998:0:14192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974571006000 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:0.0:1782607781.754001:0:14192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9fe074e/0x8109266df35cc338 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.754008:0:14192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9fe074e/0x8109266df35cc338 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.754018:0:14192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9fe074e/0x8109266df35cc338 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.754025:0:14192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9fe074e/0x8109266df35cc338 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.754049:0:14192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782607781.754053:0:14192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9d8e38f/0x8109266df35cc33f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.754060:0:14192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974571006200 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:0.0:1782607781.754063:0:14192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9d8e38f/0x8109266df35cc33f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.754071:0:14192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9d8e38f/0x8109266df35cc33f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.754081:0:14192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9d8e38f/0x8109266df35cc33f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.754089:0:14192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9d8e38f/0x8109266df35cc33f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.754100:0:14192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782607781.754104:0:14192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2933bad/0x8109266df35cc346 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.754110:0:14192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974571007200 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:0.0:1782607781.754113:0:14192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2933bad/0x8109266df35cc346 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.754132:0:14192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2933bad/0x8109266df35cc346 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.754142:0:14192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2933bad/0x8109266df35cc346 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.754150:0:14192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2933bad/0x8109266df35cc346 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.754174:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607781.754176:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607781.754178:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607781.754187:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782607781.756128:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782607781.756141:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078a5fb9b/0x8109266df35cc34d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.756173:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1782607781.756178:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607781.756185:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078a5fb9b/0x8109266df35cc34d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.756200:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078a5fb9b/0x8109266df35cc34d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.756211:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078a5fb9b/0x8109266df35cc34d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.756220:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078a5fb9b/0x8109266df35cc34d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.756240:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782607781.756930:0:14192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782607781.756939:0:14192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078a5fb9b/0x8109266df35cc34d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.756949:0:14192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974571006e00 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:0.0:1782607781.756955:0:14192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078a5fb9b/0x8109266df35cc34d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.756964:0:14192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078a5fb9b/0x8109266df35cc34d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.756982:0:14192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078a5fb9b/0x8109266df35cc34d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.756997:0:14192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078a5fb9b/0x8109266df35cc34d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.757018:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607781.757019:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607781.757022:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782607781.757720:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782607781.757729:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ee70695/0x8109266df35cc354 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.757742:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1782607781.757746:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607781.757752:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ee70695/0x8109266df35cc354 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.757786:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ee70695/0x8109266df35cc354 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.758240:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ee70695/0x8109266df35cc354 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.758249:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ee70695/0x8109266df35cc354 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.758267:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782607781.758326:0:14193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782607781.758334:0:14193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ee70695/0x8109266df35cc354 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.758344:0:14193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974571006400 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:0.0:1782607781.758348:0:14193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ee70695/0x8109266df35cc354 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.758356:0:14193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ee70695/0x8109266df35cc354 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.758370:0:14193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ee70695/0x8109266df35cc354 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.758376:0:14193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ee70695/0x8109266df35cc354 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.758393:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607781.758395:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607781.758397:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782607781.759583:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782607781.759593:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d49520ef/0x8109266df35cc35b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.759606:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1782607781.759610:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607781.759615:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d49520ef/0x8109266df35cc35b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.759628:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d49520ef/0x8109266df35cc35b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.759638:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d49520ef/0x8109266df35cc35b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.759646:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d49520ef/0x8109266df35cc35b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.760131:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782607781.760641:0:14192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782607781.760650:0:14192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d49520ef/0x8109266df35cc35b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.760660:0:14192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974571006600 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:0.0:1782607781.760664:0:14192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d49520ef/0x8109266df35cc35b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.760675:0:14192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d49520ef/0x8109266df35cc35b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.760693:0:14192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d49520ef/0x8109266df35cc35b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.760701:0:14192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d49520ef/0x8109266df35cc35b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.760721:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607781.760723:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607781.760725:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782607781.761352:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782607781.761362:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003da296e/0x8109266df35cc362 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.761375:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1782607781.761379:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607781.761385:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003da296e/0x8109266df35cc362 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.761398:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003da296e/0x8109266df35cc362 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.761408:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003da296e/0x8109266df35cc362 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.761417:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003da296e/0x8109266df35cc362 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.761509:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782607781.761527:0:14193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782607781.761536:0:14193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003da296e/0x8109266df35cc362 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607781.761545:0:14193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974571006a00 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:2.0:1782607781.761555:0:14193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003da296e/0x8109266df35cc362 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607781.761565:0:14193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003da296e/0x8109266df35cc362 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607781.761579:0:14193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003da296e/0x8109266df35cc362 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607781.761587:0:14193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003da296e/0x8109266df35cc362 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607781.761606:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607781.761609:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607781.761611:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782607781.762052:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782607781.762059:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029163cdc/0x8109266df35cc369 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.762069:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1782607781.762079:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607781.762083:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029163cdc/0x8109266df35cc369 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.762093:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029163cdc/0x8109266df35cc369 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.762102:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029163cdc/0x8109266df35cc369 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.762109:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029163cdc/0x8109266df35cc369 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.762135:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782607781.762169:0:14192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782607781.762175:0:14192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029163cdc/0x8109266df35cc369 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.762183:0:14192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974571007a00 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:0.0:1782607781.762187:0:14192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029163cdc/0x8109266df35cc369 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.762207:0:14192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029163cdc/0x8109266df35cc369 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.762219:0:14192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029163cdc/0x8109266df35cc369 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.762227:0:14192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029163cdc/0x8109266df35cc369 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.762249:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607781.762251:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607781.762254:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782607781.762927:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782607781.762935:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e1ab6a2/0x8109266df35cc370 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.762946:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1782607781.762950:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607781.762955:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e1ab6a2/0x8109266df35cc370 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.762966:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e1ab6a2/0x8109266df35cc370 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.762975:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e1ab6a2/0x8109266df35cc370 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.762990:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e1ab6a2/0x8109266df35cc370 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.763008:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1782607781.764366:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782607781.764376:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1b428c1/0x8109266df35cc377 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.764390:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1782607781.764394:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607781.764400:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1b428c1/0x8109266df35cc377 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.764413:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1b428c1/0x8109266df35cc377 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.764498:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1b428c1/0x8109266df35cc377 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.764508:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1b428c1/0x8109266df35cc377 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.764529:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1782607781.766407:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782607781.766423:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f668897/0x8109266df35cc37e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.766518:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1782607781.766523:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607781.766530:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f668897/0x8109266df35cc37e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.766543:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f668897/0x8109266df35cc37e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.766555:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f668897/0x8109266df35cc37e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.766563:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f668897/0x8109266df35cc37e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.766575:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000004:00080000:2.0:1782607781.766739:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1782607781.766877:0:14192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782607781.766888:0:14192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e1ab6a2/0x8109266df35cc370 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.766898:0:14192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974571006c00 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:0.0:1782607781.766903:0:14192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e1ab6a2/0x8109266df35cc370 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.766914:0:14192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e1ab6a2/0x8109266df35cc370 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.766934:0:14192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e1ab6a2/0x8109266df35cc370 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.766952:0:14192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e1ab6a2/0x8109266df35cc370 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.766975:0:14192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782607781.766978:0:14192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1b428c1/0x8109266df35cc377 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.766985:0:14192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974571007800 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:0.0:1782607781.766988:0:14192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1b428c1/0x8109266df35cc377 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.766996:0:14192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1b428c1/0x8109266df35cc377 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.767007:0:14192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1b428c1/0x8109266df35cc377 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.767013:0:14192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1b428c1/0x8109266df35cc377 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.767025:0:14192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782607781.767028:0:14192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f668897/0x8109266df35cc37e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.767034:0:14192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974571007c00 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:0.0:1782607781.767042:0:14192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f668897/0x8109266df35cc37e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.767051:0:14192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f668897/0x8109266df35cc37e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.767064:0:14192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f668897/0x8109266df35cc37e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.767071:0:14192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f668897/0x8109266df35cc37e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.767090:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607781.767093:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607781.767096:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607781.767550:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782607781.768556:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782607781.768565:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb5cca14/0x8109266df35cc385 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.768582:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=440s v=(0 0) 00010000:00010000:0.0:1782607781.768586:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607781.768592:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb5cca14/0x8109266df35cc385 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.768604:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb5cca14/0x8109266df35cc385 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.768613:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb5cca14/0x8109266df35cc385 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.768627:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb5cca14/0x8109266df35cc385 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.768657:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1782607781.769128:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782607781.769135:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb532ce0/0x8109266df35cc38c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.769145:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=440s v=(0 0) 00010000:00010000:0.0:1782607781.769148:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607781.769152:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb532ce0/0x8109266df35cc38c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.769295:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb532ce0/0x8109266df35cc38c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.769305:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb532ce0/0x8109266df35cc38c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.769315:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb532ce0/0x8109266df35cc38c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.769330:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1782607781.769761:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782607781.769792:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000681747a9/0x8109266df35cc393 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.769807:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=440s v=(0 0) 00010000:00010000:0.0:1782607781.769811:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607781.769815:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000681747a9/0x8109266df35cc393 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.769824:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000681747a9/0x8109266df35cc393 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.769832:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000681747a9/0x8109266df35cc393 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.769840:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000681747a9/0x8109266df35cc393 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607781.769848:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00080000:0.0:1782607781.770041:0:14840:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00010000:00010000:1.0:1782607781.770242:0:14193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782607781.770249:0:14193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb5cca14/0x8109266df35cc385 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.770257:0:14193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c43a00 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:1.0:1782607781.770262:0:14193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb5cca14/0x8109266df35cc385 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.770281:0:14193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb5cca14/0x8109266df35cc385 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.770308:0:14193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb5cca14/0x8109266df35cc385 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.770314:0:14193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb5cca14/0x8109266df35cc385 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.770331:0:14193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782607781.770333:0:14193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb532ce0/0x8109266df35cc38c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.770339:0:14193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c43200 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:1.0:1782607781.770343:0:14193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb532ce0/0x8109266df35cc38c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.770350:0:14193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb532ce0/0x8109266df35cc38c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.770358:0:14193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb532ce0/0x8109266df35cc38c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.770364:0:14193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb532ce0/0x8109266df35cc38c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.770374:0:14193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782607781.770377:0:14193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000681747a9/0x8109266df35cc393 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.770388:0:14193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42e00 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:1.0:1782607781.770392:0:14193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000681747a9/0x8109266df35cc393 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.770400:0:14193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000681747a9/0x8109266df35cc393 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.770411:0:14193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000681747a9/0x8109266df35cc393 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.770418:0:14193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000681747a9/0x8109266df35cc393 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607781.770430:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607781.770432:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607781.770433:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607781.770440:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782607781.770741:0:14840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974577609180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14227:x1869199364425344:12345-0@lo:5:osp-pre-0-0.0 Request processed in 62682us (63133us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607781.770754:0:14840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782607781.770973:0:14227:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457760b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14227:1869199364425344:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1782607781.770991:0:14227:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:2.0:1782607781.771042:0:14227:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457760b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14227:1869199364425472:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1782607781.774409:0:14227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607781.774483:0:14227:0:(client.c:2701:ptlrpc_set_wait()) set ffff97455362dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1782607781.774616:0:14839:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364425472 00000100:00100000:1.0:1782607781.774626:0:14839:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364425472 00000100:00100000:1.0:1782607781.774932:0:14839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782607781.774945:0:14839:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974577608380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14227:x1869199364425472:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1782607781.775007:0:14839:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:1.0:1782607781.782723:0:14839:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974577608380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14227:x1869199364425472:12345-0@lo:5:osp-pre-0-0.0 Request processed in 7773us (8315us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1782607781.782735:0:14839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782607781.783131:0:14227:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457760b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14227:1869199364425472:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1782607781.783148:0:14227:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:1.0:1782607781.890109:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782607782.915918:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1782607783.660982:0:15504:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1782607783.660985:0:15504:0:(obd_mount.c:917:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1782607783.661118:0:15504:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff974551309000 00000020:01000004:2.0:1782607783.661134:0:15504:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1782607783.661147:0:15504:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1782607783.661161:0:15504:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff974544318000) 00000020:00000080:2.0:1782607783.661177:0:15504:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1782607783.679094:0:15504:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1782607783.679339:0:15504:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1782607783.681470:0:15504:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1782607783.681680:0:15504:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1782607783.682239:0:15504:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1782607783.682661:0:15504:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 569: rc = 0 00100000:10000000:1.0:1782607783.682723:0:15504:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 569: rc = 0 00100000:10000000:1.0:1782607783.682895:0:15504:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 569: rc = 0 00100000:10000000:1.0:1782607783.683565:0:15504:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 242: rc = 0 00100000:10000000:1.0:1782607783.683898:0:15504:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 242: rc = 0 00100000:10000000:1.0:1782607783.684266:0:15504:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 242: rc = 0 00100000:10000000:1.0:1782607783.684521:0:15504:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 242: rc = 0 00100000:10000000:1.0:1782607783.684723:0:15504:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 242: rc = 0 00100000:10000000:1.0:1782607783.685509:0:15504:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 242: rc = 0 00000020:00000080:1.0:1782607783.686447:0:15504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1782607783.686459:0:15504:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1782607783.686467:0:15504:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8109266df35cc3a1 00000020:01000004:1.0:1782607783.686474:0:15504:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1782607783.686491:0:15504:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.202.104@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1782607783.686494:0:15504:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1782607783.686498:0:15504:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1782607783.686514:0:15504:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1782607783.686517:0:15504:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.104@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1782607783.702102:0:15504:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.104@tcp ctxt 0 is initialized 00000020:01000004:1.0:1782607783.702148:0:15504:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.104@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1782607783.702153:0:15504:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1782607783.702155:0:15504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1782607783.702160:0:15504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782607783.702161:0:15504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782607783.702162:0:15504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782607783.702164:0:15504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782607783.702165:0:15504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782607783.702167:0:15504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782607783.702168:0:15504:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1782607783.702172:0:15504:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1782607783.702174:0:15504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1782607783.702175:0:15504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1782607783.702176:0:15504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782607783.702177:0:15504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782607783.702178:0:15504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782607783.702179:0:15504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782607783.702180:0:15504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782607783.702181:0:15504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782607783.702182:0:15504:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1782607783.702209:0:15504:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1782607783.702231:0:15504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:15504:1869199364425600:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1782607783.702316:0:15504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607783.702384:0:15504:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745516703c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782607783.702568:0:14198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364425600 00000100:00100000:2.0:1782607783.702577:0:14198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364425600 00000100:00100000:2.0:1782607783.702637:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1782607783.702647:0:14198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+16:15504:x1869199364425600:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1782607783.702685:0:14198:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1782607783.702688:0:14198:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1782607783.702692:0:14198:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1782607783.720319:0:14198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+16:15504:x1869199364425600:12345-0@lo:253:mount.lustre.0 Request processed in 17663us (17992us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607783.720335:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1782607783.720438:0:15504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:15504:1869199364425600:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1782607783.720454:0:15504:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1782607783.720457:0:15504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1782607783.720458:0:15504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1782607783.720459:0:15504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782607783.720461:0:15504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782607783.720462:0:15504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782607783.720463:0:15504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782607783.720465:0:15504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782607783.720466:0:15504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782607783.720467:0:15504:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1782607783.720488:0:15504:0:(tgt_mount.c:101:server_register_mount()) register mount ffff974551309000 from lustre-OST0001 10000000:01000000:1.0:1782607783.720516:0:15504:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1782607783.720519:0:15504:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1782607783.720525:0:15504:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff974577574d40 local copy 00010000:00010000:1.0:1782607783.720536:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974546c42c00/0x8109266df35cc14e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc155 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607783.720808:0:15504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:15504:1869199364425728:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782607783.720848:0:15504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607783.720875:0:15504:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745511a4240 going to sleep for 11 seconds 00000100:00100000:0.0:1782607783.720928:0:14199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364425728 00000100:00100000:0.0:1782607783.720935:0:14199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364425728 00000100:00100000:0.0:1782607783.720983:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1782607783.720992:0:14199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+16:15504:x1869199364425728:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782607783.721242:0:14199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+16:15504:x1869199364425728:12345-0@lo:501:mount.lustre.0 Request processed in 251us (394us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782607783.721250:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1782607783.721328:0:15504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:15504:1869199364425728:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1782607783.721342:0:15504:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1782607783.721464:0:15504:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1782607783.721471:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974546c42c00/0x8109266df35cc14e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc155 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607783.721481:0:15504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974546c42c00/0x8109266df35cc14e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc155 expref: -99 pid: 14186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782607783.721502:0:15504:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff974551309000 10000000:01000000:1.0:1782607783.721507:0:15504:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1782607783.721513:0:15504:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1782607783.721516:0:15504:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782607783.721521:0:15504:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1782607783.721525:0:15504:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1782607783.721550:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974571006800/0x8109266df35cc3a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607783.721558:0:15504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974571006800/0x8109266df35cc3a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607783.721568:0:15504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974571006800/0x8109266df35cc3a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607783.721593:0:15504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:15504:1869199364425856:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782607783.721618:0:15504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607783.721641:0:15504:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745511a4240 going to sleep for 11 seconds 00000100:00100000:0.0:1782607783.721690:0:14198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364425856 00000100:00100000:0.0:1782607783.721695:0:14198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364425856 00000100:00100000:0.0:1782607783.721729:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1782607783.721736:0:14198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+16:15504:x1869199364425856:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782607783.721745:0:14198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607783.721757:0:14198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974546c43a00/0x8109266df35cc3af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cc3a8 expref: -99 pid: 14198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607783.721805:0:14198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974546c43a00/0x8109266df35cc3af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cc3a8 expref: 17 pid: 14198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607783.721815:0:14198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974546c43a00/0x8109266df35cc3af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cc3a8 expref: 17 pid: 14198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607783.721824:0:14198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974546c43a00, rc 0) 00000100:00100000:0.0:1782607783.721858:0:14198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+17:15504:x1869199364425856:12345-0@lo:101:mount.lustre.0 Request processed in 123us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607783.721864:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1782607783.721972:0:15504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:15504:1869199364425856:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782607783.721984:0:15504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974571006800/0x8109266df35cc3a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc3af expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607783.721992:0:15504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974571006800/0x8109266df35cc3a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cc3af expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782607783.723007:0:15504:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1782607783.723818:0:15504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782607783.724026:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1782607783.724069:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1782607783.724102:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1782607783.724150:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1782607783.724187:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1782607783.724221:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1782607783.724301:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1782607783.724309:0:15504:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1782607783.724386:0:15504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974443368700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:15504:1869199364425984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782607783.724445:0:15504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607783.724484:0:15504:0:(client.c:2701:ptlrpc_set_wait()) set ffff97458124a300 going to sleep for 11 seconds 00000100:00100000:2.0:1782607783.724622:0:14198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364425984 00000100:00100000:2.0:1782607783.724630:0:14198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364425984 00000100:00100000:2.0:1782607783.724680:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782607783.724689:0:14198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+17:15504:x1869199364425984:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782607783.725107:0:14198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+17:15504:x1869199364425984:12345-0@lo:501:mount.lustre.0 Request processed in 418us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607783.725115:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1782607783.725676:0:15504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974443368700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:15504:1869199364425984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782607783.725716:0:15504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974443368700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:15504:1869199364426112:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782607783.725761:0:15504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607783.725807:0:15504:0:(client.c:2701:ptlrpc_set_wait()) set ffff97458124a300 going to sleep for 11 seconds 00000100:00100000:2.0:1782607783.725854:0:14198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364426112 00000100:00100000:2.0:1782607783.725860:0:14198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364426112 00000100:00100000:2.0:1782607783.725893:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1782607783.725900:0:14198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+17:15504:x1869199364426112:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782607783.726179:0:14198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+17:15504:x1869199364426112:12345-0@lo:503:mount.lustre.0 Request processed in 279us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607783.726187:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1782607783.726320:0:15504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974443368700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:15504:1869199364426112:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1782607783.726675:0:15504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782607783.726718:0:15504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974443368700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:15504:1869199364426240:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782607783.726899:0:15504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607783.726924:0:15504:0:(client.c:2701:ptlrpc_set_wait()) set ffff974549326b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782607783.726943:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364426240 00000100:00100000:0.0:1782607783.726948:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364426240 00000100:00100000:0.0:1782607783.727022:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782607783.727030:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+17:15504:x1869199364426240:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782607783.727216:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+17:15504:x1869199364426240:12345-0@lo:502:mount.lustre.0 Request processed in 186us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607783.727233:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1782607783.727330:0:15504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974443368700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:15504:1869199364426240:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782607783.727525:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1782607783.727567:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1782607783.727608:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1782607783.727646:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1782607783.727678:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1782607783.727704:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1782607783.727742:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1782607783.727807:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1782607783.727857:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1782607783.727884:0:15504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974443368700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:15504:1869199364426368:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782607783.727921:0:15504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607783.728290:0:15504:0:(client.c:2701:ptlrpc_set_wait()) set ffff974549326b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782607783.728357:0:14198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364426368 00000100:00100000:2.0:1782607783.728363:0:14198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364426368 00000100:00100000:2.0:1782607783.728399:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1782607783.728407:0:14198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97454a726850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+17:15504:x1869199364426368:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782607783.728577:0:14198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97454a726850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+17:15504:x1869199364426368:12345-0@lo:502:mount.lustre.0 Request processed in 170us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607783.728585:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1782607783.728669:0:15504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974443368700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:15504:1869199364426368:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782607783.728732:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1782607783.728742:0:15504:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1782607783.729648:0:15505:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1782607783.729657:0:15505:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1782607783.729663:0:15505:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782607783.729665:0:15505:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1782607783.729670:0:15505:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782607783.729685:0:15505:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff974549e68000) 00000020:00000080:3.0:1782607783.729706:0:15505:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1782607783.729711:0:15505:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1782607783.729822:0:15505:0:(tgt_mount.c:153:server_get_mount()) get mount ffff974551309000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1782607783.729830:0:15505:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1782607783.729838:0:15505:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8109266df35cc3bd 00010000:00010000:3.0:1782607783.733593:0:15505:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1782607783.734049:0:15505:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1782607783.736307:0:15505:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1782607783.738328:0:15505:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1782607783.738340:0:15505:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782607783.738347:0:15505:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782607783.738350:0:15505:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1782607783.738354:0:15505:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782607783.738359:0:15505:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782607783.738360:0:15505:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1782607783.738363:0:15505:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1782607783.738365:0:15505:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1782607783.738367:0:15505:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782607783.738370:0:15505:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782607783.738371:0:15505:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:2.0:1782607783.738373:0:15505:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782607783.738376:0:15505:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782607783.738377:0:15505:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1782607783.738380:0:15505:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1782607783.738440:0:15505:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782607783.738443:0:15505:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782607783.738444:0:15505:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1782607783.738447:0:15505:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1782607783.738608:0:15504:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1782607783.738640:0:15504:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1782607783.738711:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974571006800/0x8109266df35cc3a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc3af expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607783.738731:0:15504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974571006800/0x8109266df35cc3a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc3af expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782607783.738741:0:15504:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff974551309000 from 1 10000000:01000000:3.0:1782607783.738744:0:15504:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782607783.738814:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97455d649600/0x8109266df35cc3c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607783.738823:0:15504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff97455d649600/0x8109266df35cc3c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607783.738835:0:15504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff97455d649600/0x8109266df35cc3c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607783.738860:0:15504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974443368700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:15504:1869199364426496:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782607783.738928:0:15504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607783.738961:0:15504:0:(client.c:2701:ptlrpc_set_wait()) set ffff97458124a300 going to sleep for 11 seconds 00000100:00100000:2.0:1782607783.742870:0:14198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364426496 00000100:00100000:2.0:1782607783.742883:0:14198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364426496 00000100:00100000:2.0:1782607783.742949:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1782607783.742959:0:14198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97454a725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+17:15504:x1869199364426496:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782607783.742978:0:14198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607783.742997:0:14198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9745585ac400/0x8109266df35cc3cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cc3c4 expref: -99 pid: 14198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607783.743034:0:14198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9745585ac400/0x8109266df35cc3cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cc3c4 expref: 18 pid: 14198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607783.743046:0:14198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9745585ac400/0x8109266df35cc3cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cc3c4 expref: 18 pid: 14198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607783.743055:0:14198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585ac400, rc 0) 00000100:00100000:2.0:1782607783.743128:0:14198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97454a725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+18:15504:x1869199364426496:12345-0@lo:101:mount.lustre.0 Request processed in 170us (4199us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607783.743136:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1782607783.743295:0:15504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974443368700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:15504:1869199364426496:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782607783.743314:0:15504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff97455d649600/0x8109266df35cc3c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc3cb expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607783.743324:0:15504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff97455d649600/0x8109266df35cc3c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cc3cb expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782607783.743898:0:15504:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1782607783.744201:0:15504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782607783.744465:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1782607783.744511:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1782607783.744587:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1782607783.744594:0:15504:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1782607783.744660:0:15504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974443368700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:15504:1869199364426624:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782607783.744717:0:15504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607783.744759:0:15504:0:(client.c:2701:ptlrpc_set_wait()) set ffff97458124a300 going to sleep for 11 seconds 00000100:00100000:2.0:1782607783.744926:0:14199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364426624 00000100:00100000:2.0:1782607783.744932:0:14199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364426624 00000100:00100000:2.0:1782607783.744979:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1782607783.744988:0:14199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97454a727c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+18:15504:x1869199364426624:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782607783.745236:0:14199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97454a727c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+18:15504:x1869199364426624:12345-0@lo:501:mount.lustre.0 Request processed in 249us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607783.745244:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1782607783.745452:0:15504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974443368700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:15504:1869199364426624:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782607783.745489:0:15504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974443368700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:15504:1869199364426752:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782607783.745530:0:15504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607783.745561:0:15504:0:(client.c:2701:ptlrpc_set_wait()) set ffff97458124a300 going to sleep for 11 seconds 00000100:00100000:2.0:1782607783.745603:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364426752 00000100:00100000:2.0:1782607783.745607:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364426752 00000100:00100000:2.0:1782607783.745638:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1782607783.745644:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97454a724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+18:15504:x1869199364426752:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782607783.745947:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97454a724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+18:15504:x1869199364426752:12345-0@lo:503:mount.lustre.0 Request processed in 301us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607783.745953:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1782607783.746043:0:15504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974443368700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:15504:1869199364426752:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1782607783.747117:0:15504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782607783.747431:0:15504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:15504:1869199364426880:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782607783.747491:0:15504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607783.747562:0:15504:0:(client.c:2701:ptlrpc_set_wait()) set ffff97458124a300 going to sleep for 11 seconds 00000100:00100000:3.0:1782607783.754033:0:14198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364426880 00000100:00100000:3.0:1782607783.754051:0:14198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364426880 00000100:00100000:3.0:1782607783.754703:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1782607783.754716:0:14198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549baa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+18:15504:x1869199364426880:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782607783.755081:0:14198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549baa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+18:15504:x1869199364426880:12345-0@lo:502:mount.lustre.0 Request processed in 367us (7588us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607783.755089:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1782607783.755362:0:15504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:15504:1869199364426880:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782607783.755660:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1782607783.755717:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1782607783.755795:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1782607783.755836:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1782607783.755870:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1782607783.755918:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1782607783.755952:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1782607783.755986:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1782607783.756024:0:15504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:15504:1869199364427008:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782607783.756084:0:15504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607783.756282:0:14199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364427008 00000100:00100000:0.0:1782607783.756290:0:14199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364427008 00000100:00100000:0.0:1782607783.756334:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1782607783.756344:0:14199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549ba9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+18:15504:x1869199364427008:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782607783.756514:0:14199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549ba9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+18:15504:x1869199364427008:12345-0@lo:502:mount.lustre.0 Request processed in 171us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607783.756522:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1782607783.756641:0:15504:0:(client.c:2701:ptlrpc_set_wait()) set ffff974551670000 going to sleep for 11 seconds 00000100:00100000:1.0:1782607783.756659:0:15504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:15504:1869199364427008:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782607783.756749:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1782607783.756758:0:15504:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1782607783.758317:0:15509:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782607783.758329:0:15509:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782607783.758331:0:15509:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1782607783.758338:0:15509:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff974551309000 00000020:00000080:3.0:1782607783.758341:0:15509:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1782607783.758348:0:15509:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782607783.758350:0:15509:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782607783.758351:0:15509:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1782607783.758354:0:15509:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782607783.758356:0:15509:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782607783.758357:0:15509:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1782607783.758360:0:15509:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff974551309000 00000020:00000080:3.0:1782607783.758362:0:15509:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1782607783.758474:0:15509:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782607783.758478:0:15509:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782607783.758480:0:15509:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1782607783.758483:0:15509:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782607783.758485:0:15509:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782607783.758487:0:15509:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1782607783.758490:0:15509:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff974551309000 00000020:00000080:3.0:1782607783.758492:0:15509:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1782607783.760317:0:15509:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782607783.760327:0:15509:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782607783.760329:0:15509:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1782607783.760335:0:15509:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1782607783.769175:0:15504:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1782607783.769223:0:15504:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782607783.769254:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97455d649600/0x8109266df35cc3c4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc3cb expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607783.769278:0:15504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff97455d649600/0x8109266df35cc3c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc3cb expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782607783.769715:0:15504:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1782607783.769719:0:15504:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff974551309000 10000000:01000000:2.0:1782607783.769722:0:15504:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff974551309000 10000000:01000000:2.0:1782607783.769726:0:15504:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782607783.769971:0:15504:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff974551309000 from 1 10000000:01000000:2.0:1782607783.769975:0:15504:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782607783.770438:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9745585ad800/0x8109266df35cc3d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607783.770449:0:15504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff9745585ad800/0x8109266df35cc3d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607783.770460:0:15504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff9745585ad800/0x8109266df35cc3d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607783.770487:0:15504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974577608000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:15504:1869199364427136:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1782607783.770561:0:15504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607783.770710:0:15504:0:(client.c:2701:ptlrpc_set_wait()) set ffff974577a59f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782607783.776708:0:14199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364427136 00000100:00100000:3.0:1782607783.776724:0:14199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364427136 00000100:00100000:3.0:1782607783.776914:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1782607783.776926:0:14199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549bacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+18:15504:x1869199364427136:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782607783.776945:0:14199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607783.776964:0:14199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97455d649000/0x8109266df35cc3d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cc3d2 expref: -99 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607783.776994:0:14199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97455d649000/0x8109266df35cc3d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cc3d2 expref: 19 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607783.777008:0:14199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97455d649000/0x8109266df35cc3d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cc3d2 expref: 19 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607783.777441:0:14199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97455d649000, rc 0) 00000100:00100000:3.0:1782607783.777538:0:14199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549bacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+19:15504:x1869199364427136:12345-0@lo:101:mount.lustre.0 Request processed in 614us (6976us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607783.777547:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1782607783.777728:0:15504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974577608000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:15504:1869199364427136:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782607783.778172:0:15504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff9745585ad800/0x8109266df35cc3d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc3d9 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607783.778184:0:15504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff9745585ad800/0x8109266df35cc3d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cc3d9 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782607783.780129:0:15504:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1782607783.780574:0:15504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782607783.780915:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1782607783.780961:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1782607783.780993:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1782607783.781053:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1782607783.781094:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1782607783.781145:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1782607783.781183:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1782607783.781214:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1782607783.781274:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1782607783.781310:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1782607783.781343:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1782607783.781392:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1782607783.781424:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1782607783.781455:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1782607783.781500:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1782607783.781534:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1782607783.781563:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1782607783.781848:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1782607783.781890:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1782607783.781922:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1782607783.781969:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1782607783.782005:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1782607783.782039:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1782607783.782087:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1782607783.782124:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1782607783.782158:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1782607783.782223:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1782607783.782273:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1782607783.782308:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1782607783.782441:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1782607783.782480:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1782607783.782513:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1782607783.782545:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1782607783.782681:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1782607783.782722:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1782607783.782991:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1782607783.783028:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1782607783.783123:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1782607783.783132:0:15504:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1782607783.783249:0:15504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974577608000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:15504:1869199364427264:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782607783.783339:0:15504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607783.783485:0:15504:0:(client.c:2701:ptlrpc_set_wait()) set ffff974577a59f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782607783.783533:0:14198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364427264 00000100:00100000:3.0:1782607783.783548:0:14198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364427264 00000100:00100000:3.0:1782607783.783697:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782607783.783707:0:14198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549baec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+19:15504:x1869199364427264:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782607783.784139:0:14198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549baec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+19:15504:x1869199364427264:12345-0@lo:501:mount.lustre.0 Request processed in 433us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607783.784148:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1782607783.784291:0:15504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974577608000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:15504:1869199364427264:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782607783.784337:0:15504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:15504:1869199364427392:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782607783.784459:0:15504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607783.784492:0:15504:0:(client.c:2701:ptlrpc_set_wait()) set ffff974543d790c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782607783.784535:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364427392 00000100:00100000:2.0:1782607783.784539:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364427392 00000100:00100000:2.0:1782607783.784566:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1782607783.784573:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549badc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+19:15504:x1869199364427392:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782607783.784962:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549badc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+19:15504:x1869199364427392:12345-0@lo:503:mount.lustre.0 Request processed in 389us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607783.784970:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1782607783.785539:0:15504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:15504:1869199364427392:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1782607783.786545:0:15504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782607783.786698:0:15504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:15504:1869199364427520:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782607783.786851:0:15504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607783.786874:0:15504:0:(client.c:2701:ptlrpc_set_wait()) set ffff974543d790c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782607783.786983:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364427520 00000100:00100000:2.0:1782607783.786989:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364427520 00000100:00100000:2.0:1782607783.787030:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1782607783.787040:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549bae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+19:15504:x1869199364427520:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782607783.787339:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549bae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+19:15504:x1869199364427520:12345-0@lo:502:mount.lustre.0 Request processed in 300us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607783.787347:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1782607783.788421:0:15504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:15504:1869199364427520:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782607783.790430:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1782607783.790520:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1782607783.790554:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1782607783.790678:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1782607783.790717:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1782607783.790892:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1782607783.790930:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1782607783.790966:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1782607783.791016:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1782607783.791050:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1782607783.791084:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1782607783.791132:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1782607783.791941:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1782607783.791976:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1782607783.792027:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1782607783.792062:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1782607783.792091:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1782607783.792135:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1782607783.792303:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1782607783.792332:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1782607783.792439:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1782607783.792486:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1782607783.792519:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1782607783.792558:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1782607783.792660:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1782607783.792699:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1782607783.793222:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1782607783.793286:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1782607783.793340:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1782607783.793462:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1782607783.793500:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1782607783.793534:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1782607783.793567:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1782607783.793694:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1782607783.793883:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1782607783.793945:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1782607783.793981:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1782607783.794014:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1782607783.794061:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1782607783.794098:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1782607783.794222:0:15504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:15504:1869199364427648:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782607783.794324:0:15504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607783.794471:0:15504:0:(client.c:2701:ptlrpc_set_wait()) set ffff974543d790c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782607783.794534:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364427648 00000100:00100000:2.0:1782607783.794549:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364427648 00000100:00100000:2.0:1782607783.794701:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1782607783.794713:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549bafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+19:15504:x1869199364427648:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782607783.794986:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549bafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+19:15504:x1869199364427648:12345-0@lo:502:mount.lustre.0 Request processed in 274us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607783.794994:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1782607783.795086:0:15504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:15504:1869199364427648:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782607783.795193:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1782607783.795210:0:15504:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1782607783.797092:0:15514:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1782607783.797109:0:15514:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff974549e6cd40) 00000020:00000080:3.0:1782607783.797134:0:15514:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1782607783.800069:0:15514:0:(tgt_mount.c:153:server_get_mount()) get mount ffff974551309000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1782607783.800082:0:15514:0:(tgt_mount.c:187:server_put_mount()) put mount ffff974551309000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1782607783.800085:0:15514:0:(obd_mount.c:701:lustre_put_lsi()) put ffff974551309000 3 00010000:00080000:3.0:1782607783.800131:0:15514:0:(ldlm_lib.c:102:import_set_conn()) imp ffff974543970000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.104@tcp at head 00010000:00010000:0.0:1782607783.802370:0:15514:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1782607783.802484:0:15514:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1782607783.802534:0:15514:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1782607783.802547:0:15514:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x8109266df35cc3e7 00000100:00080000:0.0:1782607783.802560:0:15514:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782607783.802567:0:15514:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff974543970000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1782607783.802610:0:15514:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff974549e7e680 x1869199364427776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782607783.802651:0:15514:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1782607783.802847:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974549e7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3315:1869199364427776:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1782607783.802931:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1782607783.803090:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782607783.803095:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1782607783.803098:0:37:0:(import.c:65:import_set_state_nolock()) ffff97456fd52000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782607783.803103:0:37:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 440 00000100:00080000:3.0:1782607783.803108:0:37:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1782607783.803112:0:37:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97456fd52000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1782607783.803127:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97444336a680 x1869199364428032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782607783.803143:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364427776 00000100:00100000:0.0:1782607783.803151:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364427776 00000100:00100000:0.0:1782607783.803189:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782607783.803197:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974577608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3315:x1869199364427776:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1782607783.803222:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97444336b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364427904:0@lo:400:kworker.0 00010000:00080000:0.0:1782607783.803240:0:14206:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 442 last 0 00000100:00100000:2.0:1782607783.803271:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1782607783.803301:0:14206:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x8109266df35cc3ee 00000004:00100000:0.0:1782607783.803321:0:14206:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1782607783.803359:0:14206:0:(import.c:65:import_set_state_nolock()) ffff974577c1c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782607783.803420:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974577608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869199364427776:12345-0@lo:38:llog_process_th.0 Request processed in 222us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607783.803436:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782607783.803448:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97444336a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1869199364428032:0@lo:8:kworker.0 00000100:00100000:0.0:1782607783.803468:0:14840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364427904 00000100:00100000:0.0:1782607783.803474:0:14840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364427904 00000100:00100000:2.0:1782607783.803480:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1782607783.803517:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff974549e7e680 x1869199364427776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782607793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782607783.803529:0:3315:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782607783.803537:0:3315:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00100000:0.0:1782607783.803538:0:14840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364428032 00000100:00100000:0.0:1782607783.803543:0:14840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364428032 00000100:00080000:2.0:1782607783.803546:0:3315:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1782607783.803553:0:3315:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1782607783.803556:0:3315:0:(import.c:65:import_set_state_nolock()) ffff974543970000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1782607783.803559:0:14840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782607783.803566:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974549e7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3315:1869199364427776:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1782607783.803572:0:14840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457760a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3319:x1869199364427904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607783.803615:0:14840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457760a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3319:x1869199364427904:12345-0@lo:400:kworker.0 Request processed in 48us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607783.803622:0:14840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782607783.803635:0:14840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782607783.803638:0:14840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457760bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3315:x1869199364428032:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1782607783.803679:0:14840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457760bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3315:x1869199364428032:12345-0@lo:8:kworker.0 Request processed in 38us (202us total) trans 0 rc -11/-11 00000100:00100000:0.0:1782607783.803686:0:14840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782607783.803708:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974443369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869199364428160:0@lo:400:kworker.0 00000100:00100000:1.0:1782607783.803917:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974443369880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1869199364428288:0@lo:400:kworker.0 00000100:00100000:1.0:1782607783.803948:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607783.804123:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1782607783.808014:0:14200:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1782607783.808822:0:15514:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1782607783.808901:0:15504:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1782607783.808946:0:15504:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782607783.808967:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9745585ad800/0x8109266df35cc3d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc3d9 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607783.808979:0:15504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff9745585ad800/0x8109266df35cc3d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc3d9 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1782607783.809110:0:15504:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1782607783.809113:0:15504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1782607783.809114:0:15504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782607783.809115:0:15504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782607783.809117:0:15504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782607783.809118:0:15504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782607783.809120:0:15504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782607783.809122:0:15504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782607783.809123:0:15504:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1782607783.809127:0:15504:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1782607783.809129:0:15504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1782607783.809130:0:15504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1782607783.809131:0:15504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782607783.809132:0:15504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782607783.809133:0:15504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782607783.809134:0:15504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782607783.809135:0:15504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782607783.809136:0:15504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782607783.809199:0:15504:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1782607783.809226:0:15504:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1782607783.809246:0:15504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:15504:1869199364428416:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1782607783.809322:0:15504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607783.809399:0:15504:0:(client.c:2701:ptlrpc_set_wait()) set ffff974543d790c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782607783.809569:0:14204:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364428288 00000100:00100000:2.0:1782607783.809578:0:14204:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364428288 00000100:00100000:2.0:1782607783.809654:0:14204:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364428160 00000100:00100000:2.0:1782607783.809658:0:14204:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364428160 00000100:00100000:2.0:1782607783.809677:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782607783.809686:0:14204:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f40f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869199364428288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607783.809896:0:14204:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f40f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869199364428288:12345-0@lo:400:kworker.0 Request processed in 210us (5946us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607783.809904:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782607783.809921:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782607783.809928:0:14204:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549e7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869199364428160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607783.809958:0:14204:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549e7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869199364428160:12345-0@lo:400:kworker.0 Request processed in 31us (5835us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607783.809965:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1782607783.810014:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff974443369880 x1869199364428288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782607799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782607783.810030:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974443369880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1869199364428288:0@lo:400:kworker.0 00000100:00080000:1.0:1782607783.810161:0:14200:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782607783.810275:0:14198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364428416 00000100:00100000:3.0:1782607783.810280:0:14198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364428416 00000100:00100000:3.0:1782607783.810347:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1782607783.810356:0:14198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549baf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+19:15504:x1869199364428416:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1782607783.810385:0:14198:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1782607783.810398:0:14198:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1782607783.811116:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97444336b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364427904:0@lo:400:kworker.0 00000100:00100000:1.0:1782607783.811169:0:3315:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1782607783.811176:0:3315:0:(import.c:65:import_set_state_nolock()) ffff97456fd52000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782607783.811188:0:3315:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1782607783.811192:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97444336a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1869199364428032:0@lo:8:kworker.0 00010000:00080000:1.0:1782607783.811230:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff974443369180 x1869199364428160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782607799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782607783.811241:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974443369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869199364428160:0@lo:400:kworker.0 20000000:01000000:0.0:1782607783.839583:0:14198:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1782607783.839634:0:14198:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1782607783.839976:0:14220:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1782607783.839982:0:14220:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1782607783.840005:0:14220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97455d648600/0x8109266df35cc3f5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607783.840034:0:14220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9745585ac600/0x8109266df35cc2cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cc2c8 expref: 19 pid: 14197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607783.840044:0:14220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97455d648600/0x8109266df35cc3f5 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607783.840356:0:14220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9745585ac600/0x8109266df35cc2cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8109266df35cc2c8 expref: 19 pid: 14197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607783.840375:0:14220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9745585ac600/0x8109266df35cc2cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8109266df35cc2c8 expref: 19 pid: 14197 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607783.840390:0:14220:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97444336aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14220:1869199364428544:0@lo:104: 00000100:00100000:3.0:1782607783.840458:0:14220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607783.840541:0:14220:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745799799c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782607783.842605:0:14188:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364428544 00000100:00100000:0.0:1782607783.842619:0:14188:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364428544 00000100:00100000:0.0:1782607783.842670:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782607783.842681:0:14188:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443369c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33f55b46-a882-437e-a0a1-2be6832a7ec1+3:14220:x1869199364428544:12345-0@lo:104: 00010000:00010000:0.0:1782607783.842698:0:14188:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff974546c42200/0x8109266df35cc2c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cc2cf expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607783.843681:0:14188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1782607783.843691:0:14193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782607783.843700:0:14193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974546c42200/0x8109266df35cc2c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cc2cf expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607783.843702:0:14188:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443369c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33f55b46-a882-437e-a0a1-2be6832a7ec1+3:14220:x1869199364428544:12345-0@lo:104: Request processed in 1022us (3244us total) trans 0 rc 0/0 00010000:00010000:1.0:1782607783.843709:0:14193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42200 already unused, calling callback (ffffffffc1db0c20) 00000100:00100000:0.0:1782607783.843710:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 10000000:00010000:1.0:1782607783.843713:0:14193:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974546c42200/0x8109266df35cc2c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8109266df35cc2cf expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607783.843722:0:14193:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974546c42200/0x8109266df35cc2c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8109266df35cc2cf expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782607783.843728:0:14193:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974546c42200/0x8109266df35cc2c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8109266df35cc2cf expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782607783.843930:0:14193:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1782607783.843968:0:14193:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974546c42200/0x8109266df35cc2c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cc2cf expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607783.843975:0:14193:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782607783.843997:0:14193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974546c42200/0x8109266df35cc2c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cc2cf expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607783.844004:0:14193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974546c42200/0x8109266df35cc2c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cc2cf expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607783.844032:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607783.844033:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607783.844035:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607783.844051:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33f55b46-a882-437e-a0a1-2be6832a7ec1:3318:1869199364428672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782607783.844108:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607783.844173:0:14191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364428672 00000100:00100000:1.0:1782607783.844179:0:14191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364428672 00010000:00010000:1.0:1782607783.844203:0:14191:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9745585ac600/0x8109266df35cc2cf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cc2c8 expref: 20 pid: 14197 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607783.844229:0:14191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782607783.844236:0:14191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f40e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33f55b46-a882-437e-a0a1-2be6832a7ec1+20:3318:x1869199364428672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782607783.844248:0:14191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782607783.844253:0:14191:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9745585ac600/0x8109266df35cc2cf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cc2c8 expref: 20 pid: 14197 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607783.844278:0:14191:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9745585ac600/0x8109266df35cc2cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8109266df35cc2c8 expref: 20 pid: 14197 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607783.844296:0:14191:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97455d648600/0x8109266df35cc3f5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607783.844305:0:14191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97455d648600/0x8109266df35cc3f5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782607783.844321:0:14191:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004340193s 00010000:00010000:1.0:1782607783.844326:0:14191:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97455d648600/0x8109266df35cc3f5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607783.844343:0:14191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97455d648600/0x8109266df35cc3f5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607783.844351:0:14191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97455d648600/0x8109266df35cc3f5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607783.844369:0:14191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97455d648600/0x8109266df35cc3f5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607783.844375:0:14191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d648600 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:1.0:1782607783.844380:0:14191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97455d648600/0x8109266df35cc3f5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607783.844388:0:14191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97455d648600/0x8109266df35cc3f5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607783.844397:0:14191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97455d648600/0x8109266df35cc3f5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607783.844408:0:14191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782607783.844447:0:14191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f40e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33f55b46-a882-437e-a0a1-2be6832a7ec1+20:3318:x1869199364428672:12345-0@lo:103:ldlm_bl.0 Request processed in 212us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607783.844454:0:14191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782607783.844892:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33f55b46-a882-437e-a0a1-2be6832a7ec1:3318:1869199364428672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782607783.847552:0:14198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549baf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+19:15504:x1869199364428416:12345-0@lo:253:mount.lustre.0 Request processed in 37190us (38223us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607783.847565:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1782607783.847713:0:15504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33f55b46-a882-437e-a0a1-2be6832a7ec1:15504:1869199364428416:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1782607783.847728:0:15504:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1782607783.847743:0:15504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782607783.847745:0:15504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1782607783.847747:0:15504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782607783.847748:0:15504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782607783.847749:0:15504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782607783.847750:0:15504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782607783.847752:0:15504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782607783.847754:0:15504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782607783.847755:0:15504:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1782607783.847801:0:15504:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1782607783.850938:0:14220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9745585ac600/0x8109266df35cc2cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8109266df35cc2c8 expref: 18 pid: 14197 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607783.850963:0:14220:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97444336aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14220:1869199364428544:0@lo:104: 00010000:00010000:3.0:1782607783.851007:0:14220:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97455d648600/0x8109266df35cc3f5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607783.851070:0:14220:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97455d648600/0x8109266df35cc3f5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607783.851078:0:14220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97455d648600/0x8109266df35cc3f5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607783.851085:0:14220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97455d648600/0x8109266df35cc3f5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1782607783.852331:0:15504:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1782607783.852649:0:15504:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1782607783.853347:0:15504:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1782607783.853694:0:15504:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1782607783.854036:0:15504:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1782607783.854439:0:15504:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1782607783.855356:0:15504:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1782607783.923958:0:15504:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1782607783.923967:0:15504:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1782607783.924002:0:15504:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1782607783.924157:0:15504:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.104@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1782607783.924172:0:15504:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1782607783.924202:0:15504:0:(super25.c:188:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1782607783.938514:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607784.961869:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782607785.093752:0:6634:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1782607785.093828:0:6634:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 10000000:01000000:1.0:1782607785.412325:0:14201:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1782607785.412334:0:14201:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9745812ef000 from 8 10000000:01000000:1.0:1782607785.412339:0:14201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782607785.413639:0:14201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff974571007600/0x8109266df35cc3fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607785.413657:0:14201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff974571007600/0x8109266df35cc3fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607785.413670:0:14201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff974571007600/0x8109266df35cc3fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607785.413700:0:14201:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33f55b46-a882-437e-a0a1-2be6832a7ec1:14201:1869199364428800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782607785.413976:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607785.414028:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364428800 00000100:00100000:2.0:1782607785.414038:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364428800 00000100:00100000:2.0:1782607785.414098:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1782607785.414110:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549bac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+18:14201:x1869199364428800:12345-0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782607785.414120:0:14201:0:(client.c:2701:ptlrpc_set_wait()) set ffff974577a59180 going to sleep for 11 seconds 00010000:00010000:2.0:1782607785.414256:0:14197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607785.414279:0:14197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9745585ace00/0x8109266df35cc403 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cc3fc expref: -99 pid: 14197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607785.414308:0:14197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9745585ace00/0x8109266df35cc403 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cc3fc expref: 19 pid: 14197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607785.414320:0:14197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9745585ace00/0x8109266df35cc403 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cc3fc expref: 19 pid: 14197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607785.414330:0:14197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585ace00, rc 0) 00000100:00100000:2.0:1782607785.414549:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549bac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+19:14201:x1869199364428800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 441us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607785.414557:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782607785.418988:0:14201:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33f55b46-a882-437e-a0a1-2be6832a7ec1:14201:1869199364428800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782607785.419026:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff974571007600/0x8109266df35cc3fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc403 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607785.419040:0:14201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff974571007600/0x8109266df35cc3fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cc403 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607785.419443:0:14201:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33f55b46-a882-437e-a0a1-2be6832a7ec1:14201:1869199364428928:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1782607785.419524:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607785.419623:0:14201:0:(client.c:2701:ptlrpc_set_wait()) set ffff974577a59180 going to sleep for 11 seconds 00000100:00100000:0.0:1782607785.424077:0:14198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364428928 00000100:00100000:0.0:1782607785.424094:0:14198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364428928 00000100:00100000:0.0:1782607785.424172:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1782607785.424184:0:14198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549bae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+19:14201:x1869199364428928:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1782607785.424231:0:14198:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1782607785.424259:0:14198:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1782607785.424263:0:14198:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1782607785.424637:0:14198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549bae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+19:14201:x1869199364428928:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 447us (5105us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607785.424646:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1782607785.424885:0:14201:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33f55b46-a882-437e-a0a1-2be6832a7ec1:14201:1869199364428928:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1782607785.424973:0:14201:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1782607785.424984:0:14201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff974571007600/0x8109266df35cc3fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc403 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607785.425000:0:14201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff974571007600/0x8109266df35cc3fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc403 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607785.989070:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607787.012671:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782607787.074094:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782607787.078404:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457760b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364429056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782607787.078499:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607787.078572:0:14841:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364429056 00000100:00100000:3.0:1782607787.078583:0:14841:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364429056 00000100:00100000:3.0:1782607787.078662:0:14841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782607787.078674:0:14841:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549e7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364429056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782607787.078715:0:14841:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782607787.078792:0:14841:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549e7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364429056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607787.078800:0:14841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782607787.078842:0:3318:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00080000:1.0:1782607787.078860:0:14200:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782607787.078867:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457760b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364429056:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782607788.048956:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782607788.359018:0:14236:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1782607789.058947:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782607789.123947:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782607789.123955:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1782607789.123959:0:36:0:(import.c:65:import_set_state_nolock()) ffff97456fd52000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782607789.123974:0:36:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97456fd52000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1782607789.123995:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97457f40c000 x1869199364429440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782607789.124056:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1869199364429440:0@lo:8:kworker.0 00000100:00100000:1.0:1782607789.124120:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607789.124185:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3319:1869199364429696:0@lo:400:kworker.0 00000100:00100000:1.0:1782607789.124226:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607789.124246:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782607789.124253:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1869199364429568:0@lo:400:kworker.0 00000100:00100000:1.0:1782607789.124338:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607789.125338:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33f55b46-a882-437e-a0a1-2be6832a7ec1:3316:1869199364429184:0@lo:400:kworker.0 00000100:00100000:0.0:1782607789.125469:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607789.125524:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1869199364429824:0@lo:400:kworker.0 00000100:00100000:0.0:1782607789.125554:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607789.125579:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782607789.125586:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364429312:0@lo:400:kworker.0 00000100:00100000:0.0:1782607789.125611:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607789.125650:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364429696 00000100:00100000:0.0:1782607789.125659:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364429696 00000100:00100000:0.0:1782607789.125715:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364429568 00000100:00100000:0.0:1782607789.125719:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364429568 00000100:00100000:0.0:1782607789.125732:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364429824 00000100:00100000:0.0:1782607789.125736:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364429824 00000100:00100000:0.0:1782607789.125753:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782607789.125813:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f40f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1869199364429696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607789.125873:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f40f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1869199364429696:12345-0@lo:400:kworker.0 Request processed in 62us (1659us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607789.125881:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782607789.125900:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782607789.125906:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f40dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1869199364429568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607789.125934:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f40dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1869199364429568:12345-0@lo:400:kworker.0 Request processed in 28us (1659us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607789.125940:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782607789.125952:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782607789.125958:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549e7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869199364429824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607789.125988:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549e7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869199364429824:12345-0@lo:400:kworker.0 Request processed in 31us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607789.125994:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782607789.126016:0:14840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364429440 00000100:00100000:0.0:1782607789.126019:0:14840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364429440 00000100:00100000:0.0:1782607789.126038:0:14840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364429312 00000100:00100000:0.0:1782607789.126040:0:14840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364429312 00000100:00100000:0.0:1782607789.126076:0:14840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782607789.126081:0:14840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549e7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364429312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607789.126110:0:14840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549e7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364429312:12345-0@lo:400:kworker.0 Request processed in 29us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607789.126116:0:14840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782607789.126127:0:14840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782607789.126131:0:14840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f40ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3315:x1869199364429440:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1782607789.126152:0:14840:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 447 last 0 00000020:00000080:0.0:1782607789.126191:0:14840:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8109266df35cc40a 00002000:00100000:0.0:1782607789.126210:0:14840:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff974577c1b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113669 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1782607789.126226:0:14840:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1782607789.126229:0:14840:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1782607789.126622:0:14840:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1782607789.126654:0:14840:0:(import.c:65:import_set_state_nolock()) ffff974577c1d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782607789.126707:0:14840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f40ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3315:x1869199364429440:12345-0@lo:8:kworker.0 Request processed in 573us (2585us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607789.126713:0:14840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1782607789.126734:0:14200:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782607789.126739:0:14200:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782607789.126800:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364429312:0@lo:400:kworker.0 00010000:00080000:0.0:1782607789.126817:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97457f40d500 x1869199364429824/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782607805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782607789.126828:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1869199364429824:0@lo:400:kworker.0 00010000:00080000:0.0:1782607789.126871:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97457f40c000 x1869199364429440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782607814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1782607789.126884:0:3315:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1782607789.126894:0:3315:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1782607789.126900:0:3315:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1782607789.126903:0:3315:0:(import.c:65:import_set_state_nolock()) ffff97456fd52000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1782607789.126921:0:3315:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1782607789.126927:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1869199364429440:0@lo:8:kworker.0 00000004:00080000:0.0:1782607789.126977:0:14229:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:0.0:1782607789.126996:0:14229:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974549e7ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14229:1869199364430080:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1782607789.127035:0:14229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607789.127054:0:14229:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745509bfc00 going to sleep for 11 seconds 00000100:00100000:0.0:1782607789.127064:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782607789.127072:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974549e7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364429952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782607789.127095:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607789.127125:0:14842:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364429952 00000100:00100000:0.0:1782607789.127129:0:14842:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364429952 00000100:00100000:0.0:1782607789.127160:0:14842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782607789.127166:0:14842:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1869199364429952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782607789.127191:0:14842:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782607789.127238:0:14842:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1869199364429952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607789.127244:0:14842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1782607789.127262:0:14200:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1782607789.127283:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97457f40fb80 x1869199364429568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782607805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782607789.127293:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1869199364429568:0@lo:400:kworker.0 00010000:00080000:0.0:1782607789.127305:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97457f40df80 x1869199364429696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782607805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782607789.127313:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3319:1869199364429696:0@lo:400:kworker.0 00010000:00080000:0.0:1782607789.127343:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff974549e7c000 x1869199364429952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782607805 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782607789.127356:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974549e7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364429952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782607789.127371:0:14840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364430080 00000100:00100000:0.0:1782607789.127374:0:14840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364430080 00000100:00100000:0.0:1782607789.127407:0:14840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782607789.127412:0:14840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549e7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14229:x1869199364430080:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1782607789.128565:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364429184 00000100:00100000:1.0:1782607789.128585:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364429184 00000100:00100000:1.0:1782607789.128635:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1782607789.128643:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549bac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+19:3316:x1869199364429184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607789.128717:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549bac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+19:3316:x1869199364429184:12345-0@lo:400:kworker.0 Request processed in 75us (3248us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607789.128724:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000004:00080000:2.0:1782607789.129090:0:14228:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1782607789.130088:0:14228:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 447976320798ns, next at 0ns, rc = 0 00000100:00100000:0.0:1782607789.133762:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33f55b46-a882-437e-a0a1-2be6832a7ec1:3316:1869199364429184:0@lo:400:kworker.0 00002000:00080000:0.0:1782607789.135668:0:14840:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1782607789.135679:0:14840:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1782607789.135685:0:14840:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:0.0:1782607789.147999:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782607789.148013:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000681747a9/0x8109266df35cc411 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.148040:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=447s v=(0 0) 00010000:00010000:0.0:1782607789.148046:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607789.148053:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000681747a9/0x8109266df35cc411 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.148071:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000681747a9/0x8109266df35cc411 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.148083:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000681747a9/0x8109266df35cc411 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.148092:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000681747a9/0x8109266df35cc411 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.148141:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782607789.148155:0:14192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782607789.148160:0:14192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000681747a9/0x8109266df35cc411 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.148175:0:14192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42e00 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:0.0:1782607789.148179:0:14192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000681747a9/0x8109266df35cc411 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.148194:0:14192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000681747a9/0x8109266df35cc411 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.148221:0:14192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000681747a9/0x8109266df35cc411 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.148230:0:14192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000681747a9/0x8109266df35cc411 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.148249:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607789.148251:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607789.148253:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782607789.149313:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782607789.149324:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb532ce0/0x8109266df35cc418 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.149337:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=447s v=(0 0) 00010000:00010000:0.0:1782607789.149341:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607789.149346:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb532ce0/0x8109266df35cc418 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.149358:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb532ce0/0x8109266df35cc418 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.149373:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb532ce0/0x8109266df35cc418 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.149381:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb532ce0/0x8109266df35cc418 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.149396:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782607789.149407:0:14193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782607789.149412:0:14193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb532ce0/0x8109266df35cc418 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.149419:0:14193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c43200 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:0.0:1782607789.149422:0:14193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb532ce0/0x8109266df35cc418 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.149430:0:14193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb532ce0/0x8109266df35cc418 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.149444:0:14193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb532ce0/0x8109266df35cc418 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.149451:0:14193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb532ce0/0x8109266df35cc418 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.149465:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607789.149473:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607789.149475:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782607789.150670:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782607789.150679:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000470c81da/0x8109266df35cc41f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.150692:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=447s v=(0 0) 00010000:00010000:0.0:1782607789.150697:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607789.150703:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000470c81da/0x8109266df35cc41f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.150714:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000470c81da/0x8109266df35cc41f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.150860:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000470c81da/0x8109266df35cc41f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.150870:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000470c81da/0x8109266df35cc41f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.150931:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1782607789.151400:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782607789.151406:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7466fff/0x8109266df35cc426 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.151414:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=447s v=(0 0) 00010000:00010000:0.0:1782607789.151417:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607789.151421:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7466fff/0x8109266df35cc426 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.151437:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7466fff/0x8109266df35cc426 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.151446:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7466fff/0x8109266df35cc426 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.151453:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7466fff/0x8109266df35cc426 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.152515:0:14192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782607789.152524:0:14192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000470c81da/0x8109266df35cc41f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.152534:0:14192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42200 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:1.0:1782607789.152538:0:14192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000470c81da/0x8109266df35cc41f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.152550:0:14192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000470c81da/0x8109266df35cc41f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.152571:0:14192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000470c81da/0x8109266df35cc41f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.152674:0:14192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000470c81da/0x8109266df35cc41f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.152693:0:14192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782607789.152697:0:14192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7466fff/0x8109266df35cc426 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.152702:0:14192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42800 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:1.0:1782607789.152705:0:14192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7466fff/0x8109266df35cc426 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.152718:0:14192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7466fff/0x8109266df35cc426 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.152741:0:14192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7466fff/0x8109266df35cc426 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.152748:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607789.152750:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607789.152752:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607789.152903:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1782607789.152910:0:14840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7466fff/0x8109266df35cc426 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.153665:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782607789.154194:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782607789.154203:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000681747a9/0x8109266df35cc42d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.154307:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1782607789.154311:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607789.154318:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000681747a9/0x8109266df35cc42d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.154333:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000681747a9/0x8109266df35cc42d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.154355:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000681747a9/0x8109266df35cc42d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.154362:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000681747a9/0x8109266df35cc42d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.154452:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1782607789.154959:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782607789.154966:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ccd1157/0x8109266df35cc434 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.154975:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1782607789.154979:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607789.154983:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ccd1157/0x8109266df35cc434 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.154993:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ccd1157/0x8109266df35cc434 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.155001:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ccd1157/0x8109266df35cc434 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.155009:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ccd1157/0x8109266df35cc434 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.156279:0:14192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782607789.156289:0:14192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000681747a9/0x8109266df35cc42d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.156302:0:14192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42e00 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:1.0:1782607789.156307:0:14192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000681747a9/0x8109266df35cc42d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.156317:0:14192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000681747a9/0x8109266df35cc42d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.156338:0:14192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000681747a9/0x8109266df35cc42d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.156345:0:14192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000681747a9/0x8109266df35cc42d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.156384:0:14192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782607789.156388:0:14192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ccd1157/0x8109266df35cc434 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.156395:0:14192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42400 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:1.0:1782607789.156398:0:14192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ccd1157/0x8109266df35cc434 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.156406:0:14192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ccd1157/0x8109266df35cc434 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.156416:0:14192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ccd1157/0x8109266df35cc434 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.156423:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607789.156424:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607789.156426:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607789.156707:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1782607789.156715:0:14840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ccd1157/0x8109266df35cc434 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.158516:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782607789.159552:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782607789.159563:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7466fff/0x8109266df35cc43b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.159646:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1782607789.159652:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607789.159660:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7466fff/0x8109266df35cc43b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.159677:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7466fff/0x8109266df35cc43b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.159688:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7466fff/0x8109266df35cc43b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.159697:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7466fff/0x8109266df35cc43b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.159720:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782607789.160025:0:14192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782607789.160032:0:14192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7466fff/0x8109266df35cc43b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.160042:0:14192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42800 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:1.0:1782607789.160046:0:14192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7466fff/0x8109266df35cc43b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.160074:0:14192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7466fff/0x8109266df35cc43b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.160935:0:14192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7466fff/0x8109266df35cc43b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.161019:0:14192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7466fff/0x8109266df35cc43b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.161043:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607789.161045:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607789.161047:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782607789.161156:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782607789.161164:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb532ce0/0x8109266df35cc442 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.161182:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1782607789.161186:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607789.161191:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb532ce0/0x8109266df35cc442 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.161204:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb532ce0/0x8109266df35cc442 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.161223:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb532ce0/0x8109266df35cc442 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.161233:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb532ce0/0x8109266df35cc442 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.161287:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1782607789.161926:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782607789.161934:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a06105d1/0x8109266df35cc449 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.161945:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1782607789.162020:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607789.162026:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a06105d1/0x8109266df35cc449 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.162037:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a06105d1/0x8109266df35cc449 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.162058:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a06105d1/0x8109266df35cc449 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.162066:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a06105d1/0x8109266df35cc449 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.162314:0:14193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782607789.162321:0:14193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb532ce0/0x8109266df35cc442 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.162330:0:14193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c43200 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:1.0:1782607789.162334:0:14193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb532ce0/0x8109266df35cc442 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.162344:0:14193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb532ce0/0x8109266df35cc442 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.162360:0:14193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb532ce0/0x8109266df35cc442 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.162378:0:14193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb532ce0/0x8109266df35cc442 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.162399:0:14193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782607789.162402:0:14193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a06105d1/0x8109266df35cc449 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.162409:0:14193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c43400 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:1.0:1782607789.162412:0:14193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a06105d1/0x8109266df35cc449 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.162420:0:14193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a06105d1/0x8109266df35cc449 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.162430:0:14193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a06105d1/0x8109266df35cc449 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.162438:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607789.162439:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607789.162441:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607789.162500:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1782607789.162506:0:14840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a06105d1/0x8109266df35cc449 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782607789.163358:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782607789.163364:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073ab1624/0x8109266df35cc450 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.163374:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1782607789.163377:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607789.163382:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073ab1624/0x8109266df35cc450 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.163398:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073ab1624/0x8109266df35cc450 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.163408:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073ab1624/0x8109266df35cc450 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.163427:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073ab1624/0x8109266df35cc450 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.163471:0:14192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782607789.163477:0:14192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073ab1624/0x8109266df35cc450 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.163485:0:14192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42000 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:1.0:1782607789.163494:0:14192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073ab1624/0x8109266df35cc450 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.163504:0:14192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073ab1624/0x8109266df35cc450 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.163515:0:14192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073ab1624/0x8109266df35cc450 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.163524:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607789.163526:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607789.163527:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607789.163637:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1782607789.163642:0:14840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073ab1624/0x8109266df35cc450 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782607789.164433:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782607789.164441:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb7c2079/0x8109266df35cc457 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.164454:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1782607789.164458:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607789.164464:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb7c2079/0x8109266df35cc457 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.164475:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb7c2079/0x8109266df35cc457 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.164483:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb7c2079/0x8109266df35cc457 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.164490:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb7c2079/0x8109266df35cc457 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.164546:0:14193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782607789.164552:0:14193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb7c2079/0x8109266df35cc457 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.164559:0:14193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974546c42a00 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:1.0:1782607789.164563:0:14193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb7c2079/0x8109266df35cc457 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.164572:0:14193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb7c2079/0x8109266df35cc457 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.164655:0:14193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb7c2079/0x8109266df35cc457 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.164664:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607789.164671:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607789.164673:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607789.164735:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1782607789.164747:0:14840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb7c2079/0x8109266df35cc457 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782607789.165444:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782607789.165453:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d96479ad/0x8109266df35cc45e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.165463:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1782607789.165467:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607789.165473:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d96479ad/0x8109266df35cc45e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.165483:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d96479ad/0x8109266df35cc45e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.165492:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d96479ad/0x8109266df35cc45e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.165499:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d96479ad/0x8109266df35cc45e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.165554:0:14192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782607789.165560:0:14192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d96479ad/0x8109266df35cc45e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.165568:0:14192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974541548e00 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:1.0:1782607789.165573:0:14192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d96479ad/0x8109266df35cc45e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.165655:0:14192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d96479ad/0x8109266df35cc45e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.165668:0:14192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d96479ad/0x8109266df35cc45e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.165676:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607789.165678:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607789.165680:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607789.165741:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1782607789.165749:0:14840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d96479ad/0x8109266df35cc45e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782607789.166460:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782607789.166467:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1432643/0x8109266df35cc465 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.166478:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1782607789.166482:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607789.166487:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1432643/0x8109266df35cc465 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.166497:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1432643/0x8109266df35cc465 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.166505:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1432643/0x8109266df35cc465 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.166513:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1432643/0x8109266df35cc465 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.166668:0:14193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782607789.166675:0:14193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1432643/0x8109266df35cc465 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.166684:0:14193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974442876400 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:1.0:1782607789.166687:0:14193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1432643/0x8109266df35cc465 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.166695:0:14193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1432643/0x8109266df35cc465 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.166714:0:14193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1432643/0x8109266df35cc465 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.166722:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607789.166839:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607789.166843:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607789.166916:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1782607789.166921:0:14840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1432643/0x8109266df35cc465 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782607789.167404:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782607789.167410:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000944c69d7/0x8109266df35cc46c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.167429:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1782607789.167433:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607789.167438:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000944c69d7/0x8109266df35cc46c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.167449:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000944c69d7/0x8109266df35cc46c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.167457:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000944c69d7/0x8109266df35cc46c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.167465:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000944c69d7/0x8109266df35cc46c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.167670:0:14192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782607789.167676:0:14192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000944c69d7/0x8109266df35cc46c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.167684:0:14192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974442876600 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:1.0:1782607789.167688:0:14192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000944c69d7/0x8109266df35cc46c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.167697:0:14192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000944c69d7/0x8109266df35cc46c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.167709:0:14192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000944c69d7/0x8109266df35cc46c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.167718:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607789.167719:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607789.167721:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607789.168026:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1782607789.168032:0:14840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000944c69d7/0x8109266df35cc46c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.168167:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782607789.168935:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782607789.168943:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7870f66/0x8109266df35cc473 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.169025:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1782607789.169030:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607789.169035:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7870f66/0x8109266df35cc473 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.169059:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7870f66/0x8109266df35cc473 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.169069:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7870f66/0x8109266df35cc473 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.169078:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7870f66/0x8109266df35cc473 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.169188:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782607789.169653:0:14192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782607789.169661:0:14192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7870f66/0x8109266df35cc473 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.169677:0:14192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974442876a00 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:1.0:1782607789.169682:0:14192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7870f66/0x8109266df35cc473 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.169691:0:14192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7870f66/0x8109266df35cc473 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.169709:0:14192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7870f66/0x8109266df35cc473 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.169718:0:14192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7870f66/0x8109266df35cc473 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.170198:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607789.170202:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607789.170204:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782607789.170550:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782607789.170558:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb90b617/0x8109266df35cc47a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.170572:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1782607789.171010:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607789.171018:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb90b617/0x8109266df35cc47a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.171032:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb90b617/0x8109266df35cc47a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.171041:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb90b617/0x8109266df35cc47a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.171060:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb90b617/0x8109266df35cc47a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.171160:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1782607789.171724:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782607789.171882:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1432643/0x8109266df35cc481 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.171895:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1782607789.171898:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607789.171903:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1432643/0x8109266df35cc481 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.171913:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1432643/0x8109266df35cc481 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.171922:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1432643/0x8109266df35cc481 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.171930:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1432643/0x8109266df35cc481 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.172048:0:14193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782607789.172056:0:14193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb90b617/0x8109266df35cc47a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.172065:0:14193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974442877a00 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:1.0:1782607789.172070:0:14193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb90b617/0x8109266df35cc47a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.172080:0:14193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb90b617/0x8109266df35cc47a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.172175:0:14193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb90b617/0x8109266df35cc47a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.172185:0:14193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb90b617/0x8109266df35cc47a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.172205:0:14193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782607789.172208:0:14193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1432643/0x8109266df35cc481 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.172227:0:14193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974442876400 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:1.0:1782607789.172231:0:14193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1432643/0x8109266df35cc481 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.172240:0:14193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1432643/0x8109266df35cc481 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.172252:0:14193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1432643/0x8109266df35cc481 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.172260:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607789.172262:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607789.172264:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607789.172332:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1782607789.172337:0:14840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1432643/0x8109266df35cc481 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782607789.173067:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782607789.173075:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9d33bf9/0x8109266df35cc488 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.173086:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1782607789.173090:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607789.173165:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9d33bf9/0x8109266df35cc488 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.173181:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9d33bf9/0x8109266df35cc488 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.173189:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9d33bf9/0x8109266df35cc488 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.173198:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9d33bf9/0x8109266df35cc488 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.173361:0:14192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782607789.173368:0:14192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9d33bf9/0x8109266df35cc488 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.173386:0:14192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974442876c00 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:1.0:1782607789.173390:0:14192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9d33bf9/0x8109266df35cc488 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.173399:0:14192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9d33bf9/0x8109266df35cc488 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.173411:0:14192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9d33bf9/0x8109266df35cc488 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.173419:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607789.173421:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607789.173423:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607789.173488:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1782607789.173494:0:14840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9d33bf9/0x8109266df35cc488 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782607789.174616:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782607789.174625:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cb6a0e3/0x8109266df35cc48f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.174649:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1782607789.174653:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607789.174658:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cb6a0e3/0x8109266df35cc48f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.175196:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cb6a0e3/0x8109266df35cc48f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.175209:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cb6a0e3/0x8109266df35cc48f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.175228:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002cb6a0e3/0x8109266df35cc48f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.175427:0:14193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782607789.175435:0:14193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002cb6a0e3/0x8109266df35cc48f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.175443:0:14193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974442877800 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:1.0:1782607789.175447:0:14193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002cb6a0e3/0x8109266df35cc48f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.175457:0:14193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002cb6a0e3/0x8109266df35cc48f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.175473:0:14193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002cb6a0e3/0x8109266df35cc48f lrc: 2/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.175489:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607789.175491:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607789.175493:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607789.175526:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1782607789.175531:0:14840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cb6a0e3/0x8109266df35cc48f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.175689:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782607789.176501:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782607789.176508:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000944c69d7/0x8109266df35cc496 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.176520:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1782607789.176524:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607789.176530:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000944c69d7/0x8109266df35cc496 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.176552:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000944c69d7/0x8109266df35cc496 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.176562:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000944c69d7/0x8109266df35cc496 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.176570:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000944c69d7/0x8109266df35cc496 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.176695:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1782607789.177417:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782607789.177423:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdeac1f8/0x8109266df35cc49d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.177433:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1782607789.177436:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607789.177441:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdeac1f8/0x8109266df35cc49d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.177451:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cdeac1f8/0x8109266df35cc49d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.177460:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdeac1f8/0x8109266df35cc49d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.177479:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cdeac1f8/0x8109266df35cc49d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.177532:0:14193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782607789.177539:0:14193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000944c69d7/0x8109266df35cc496 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.177547:0:14193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974442876600 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:1.0:1782607789.177552:0:14193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000944c69d7/0x8109266df35cc496 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.177563:0:14193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000944c69d7/0x8109266df35cc496 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.177651:0:14193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000944c69d7/0x8109266df35cc496 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.177660:0:14193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000944c69d7/0x8109266df35cc496 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.177678:0:14193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782607789.177682:0:14193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cdeac1f8/0x8109266df35cc49d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.177689:0:14193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974442877c00 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:1.0:1782607789.177698:0:14193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdeac1f8/0x8109266df35cc49d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.177707:0:14193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdeac1f8/0x8109266df35cc49d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.177717:0:14193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cdeac1f8/0x8109266df35cc49d lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.177725:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607789.177857:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607789.177859:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607789.177942:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1782607789.177957:0:14840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cdeac1f8/0x8109266df35cc49d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782607789.178531:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782607789.178538:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d61ceb66/0x8109266df35cc4a4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.178549:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1782607789.178554:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607789.178559:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d61ceb66/0x8109266df35cc4a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.178569:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d61ceb66/0x8109266df35cc4a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.178592:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d61ceb66/0x8109266df35cc4a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.178600:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d61ceb66/0x8109266df35cc4a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.178691:0:14192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782607789.178698:0:14192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d61ceb66/0x8109266df35cc4a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.178706:0:14192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974442877000 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:1.0:1782607789.178710:0:14192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d61ceb66/0x8109266df35cc4a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.178718:0:14192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d61ceb66/0x8109266df35cc4a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.178871:0:14192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d61ceb66/0x8109266df35cc4a4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.178882:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607789.178890:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607789.178893:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607789.179034:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1782607789.179039:0:14840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d61ceb66/0x8109266df35cc4a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782607789.179559:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782607789.179565:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f119f9a/0x8109266df35cc4ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.179745:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1782607789.179750:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607789.179755:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f119f9a/0x8109266df35cc4ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.179791:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f119f9a/0x8109266df35cc4ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.179800:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f119f9a/0x8109266df35cc4ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.179807:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f119f9a/0x8109266df35cc4ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.180413:0:14193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782607789.180421:0:14193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f119f9a/0x8109266df35cc4ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.180430:0:14193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974442877600 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:1.0:1782607789.180435:0:14193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f119f9a/0x8109266df35cc4ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.180444:0:14193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f119f9a/0x8109266df35cc4ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.180461:0:14193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f119f9a/0x8109266df35cc4ab lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.180469:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607789.180470:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607789.180472:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607789.180550:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1782607789.180555:0:14840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f119f9a/0x8109266df35cc4ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.180928:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1782607789.181097:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:0.0:1782607789.182048:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782607789.182058:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d61ceb66/0x8109266df35cc4b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.182073:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1782607789.182077:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607789.182083:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d61ceb66/0x8109266df35cc4b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.182155:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d61ceb66/0x8109266df35cc4b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.182167:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d61ceb66/0x8109266df35cc4b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.182175:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d61ceb66/0x8109266df35cc4b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.182231:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1782607789.182876:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782607789.182888:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdeac1f8/0x8109266df35cc4b9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.182901:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1782607789.182904:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607789.182915:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdeac1f8/0x8109266df35cc4b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.182926:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cdeac1f8/0x8109266df35cc4b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.182935:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdeac1f8/0x8109266df35cc4b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.182943:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cdeac1f8/0x8109266df35cc4b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.183062:0:14193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782607789.183070:0:14193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d61ceb66/0x8109266df35cc4b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.183078:0:14193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974442877000 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:1.0:1782607789.183083:0:14193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d61ceb66/0x8109266df35cc4b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.183172:0:14193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d61ceb66/0x8109266df35cc4b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.183190:0:14193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d61ceb66/0x8109266df35cc4b2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.183198:0:14193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d61ceb66/0x8109266df35cc4b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.183224:0:14193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782607789.183228:0:14193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cdeac1f8/0x8109266df35cc4b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.183235:0:14193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974442877c00 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:1.0:1782607789.183238:0:14193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdeac1f8/0x8109266df35cc4b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.183246:0:14193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdeac1f8/0x8109266df35cc4b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.183257:0:14193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cdeac1f8/0x8109266df35cc4b9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.183265:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607789.183267:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607789.183274:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607789.183328:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1782607789.183333:0:14840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cdeac1f8/0x8109266df35cc4b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782607789.184169:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782607789.184177:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cb6a0e3/0x8109266df35cc4c0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.184190:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1782607789.184194:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607789.184203:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cb6a0e3/0x8109266df35cc4c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.184223:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cb6a0e3/0x8109266df35cc4c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.184245:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cb6a0e3/0x8109266df35cc4c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.184253:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002cb6a0e3/0x8109266df35cc4c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.184295:0:14192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782607789.184301:0:14192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002cb6a0e3/0x8109266df35cc4c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.184308:0:14192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974442877800 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:1.0:1782607789.184312:0:14192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002cb6a0e3/0x8109266df35cc4c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.184321:0:14192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002cb6a0e3/0x8109266df35cc4c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.184335:0:14192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002cb6a0e3/0x8109266df35cc4c0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.184343:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607789.184344:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607789.184346:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607789.184400:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1782607789.184406:0:14840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cb6a0e3/0x8109266df35cc4c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782607789.185082:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782607789.185089:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9d33bf9/0x8109266df35cc4c7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.185166:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1782607789.185170:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607789.185176:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9d33bf9/0x8109266df35cc4c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.185187:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9d33bf9/0x8109266df35cc4c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.185196:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9d33bf9/0x8109266df35cc4c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.185232:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9d33bf9/0x8109266df35cc4c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.185333:0:14193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782607789.185339:0:14193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9d33bf9/0x8109266df35cc4c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.185347:0:14193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974442876c00 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:1.0:1782607789.185351:0:14193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9d33bf9/0x8109266df35cc4c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.185360:0:14193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9d33bf9/0x8109266df35cc4c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.185385:0:14193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9d33bf9/0x8109266df35cc4c7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.185394:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607789.185396:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607789.185398:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607789.185456:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1782607789.185462:0:14840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9d33bf9/0x8109266df35cc4c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782607789.186290:0:14840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782607789.186296:0:14840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1432643/0x8109266df35cc4ce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.186306:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1782607789.186310:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607789.186315:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1432643/0x8109266df35cc4ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.186324:0:14840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1432643/0x8109266df35cc4ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.186333:0:14840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1432643/0x8109266df35cc4ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607789.186340:0:14840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1432643/0x8109266df35cc4ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.186411:0:14192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782607789.186416:0:14192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1432643/0x8109266df35cc4ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.186424:0:14192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974442876400 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:1.0:1782607789.186428:0:14192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1432643/0x8109266df35cc4ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.186437:0:14192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1432643/0x8109266df35cc4ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.186450:0:14192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1432643/0x8109266df35cc4ce lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607789.186458:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607789.186460:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782607789.186462:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607789.186526:0:14840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1782607789.186531:0:14840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1432643/0x8109266df35cc4ce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1782607789.186939:0:14840:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:0.0:1782607789.187051:0:14840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549e7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14229:x1869199364430080:12345-0@lo:5:osp-pre-1-0.0 Request processed in 59634us (60011us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607789.187062:0:14840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782607789.187243:0:14229:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974549e7ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14229:1869199364430080:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1782607789.187262:0:14229:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:0.0:1782607789.187313:0:14229:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974549e7ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14229:1869199364430208:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1782607789.187348:0:14229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607789.187388:0:14229:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745509bfc00 going to sleep for 11 seconds 00000100:00100000:0.0:1782607789.187405:0:14838:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364430208 00000100:00100000:0.0:1782607789.187410:0:14838:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364430208 00000100:00100000:0.0:1782607789.187458:0:14838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782607789.187467:0:14838:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549e7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14229:x1869199364430208:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1782607789.187504:0:14838:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:1.0:1782607789.194352:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607789.206922:0:14229:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974549e7ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14229:1869199364430208:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1782607789.206944:0:14229:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1782607789.208526:0:14838:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549e7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14229:x1869199364430208:12345-0@lo:5:osp-pre-1-0.0 Request processed in 19255us (19373us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1782607789.208548:0:14838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1782607790.082015:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782607790.782292:0:15860:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1782607791.107543:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607792.129917:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782607792.194837:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782607792.194870:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974549e7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364430336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782607792.194960:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607792.195523:0:14842:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364430336 00000100:00100000:0.0:1782607792.195549:0:14842:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364430336 00000100:00100000:0.0:1782607792.195623:0:14842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782607792.195633:0:14842:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97444336aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364430336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782607792.195672:0:14842:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782607792.195735:0:14842:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97444336aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364430336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607792.195742:0:14842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1782607792.195902:0:14200:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782607792.195976:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974549e7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364430336:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782607793.156249:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607793.323157:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607793.323331:0:14199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342412544 00000100:00100000:0.0:1782607793.323344:0:14199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342412544 00000100:00100000:0.0:1782607793.323403:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 75 00000100:00100000:0.0:1782607793.323415:0:14199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549bae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2353:x1869199342412544:12345-192.168.202.4@tcp:250:mount.lustre.0 00010000:00080000:0.0:1782607793.323453:0:14199:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 8e6cd414-a5bd-4223-b33a-76eff85902b7@192.168.202.4@tcp t0 exp 0000000000000000 cur 452 last 0 00000020:00000080:0.0:1782607793.323487:0:14199:0:(genops.c:1406:class_connect()) connect: client 8e6cd414-a5bd-4223-b33a-76eff85902b7, cookie 0x8109266df35cc4d5 00000100:00080000:0.0:1782607793.323641:0:14199:0:(import.c:65:import_set_state_nolock()) ffff974577c19800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782607793.323719:0:14199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549bae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e6cd414-a5bd-4223-b33a-76eff85902b7+5:2353:x1869199342412544:12345-192.168.202.4@tcp:250:mount.lustre.0 Request processed in 305us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607793.323727:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 75 00000100:00100000:3.0:1782607793.338661:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607793.338824:0:14198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342412672 00000100:00100000:0.0:1782607793.338838:0:14198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342412672 00000100:00100000:0.0:1782607793.338902:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 76 00000100:00100000:2.0:1782607793.338966:0:14198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549bad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e6cd414-a5bd-4223-b33a-76eff85902b7+5:13704:x1869199342412672:12345-192.168.202.4@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782607793.338989:0:14198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607793.339013:0:14198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9745585ac800/0x8109266df35cc4dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a780b5862a00076 expref: -99 pid: 14198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607793.339050:0:14198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9745585ac800/0x8109266df35cc4dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00076 expref: 6 pid: 14198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607793.339062:0:14198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9745585ac800/0x8109266df35cc4dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00076 expref: 6 pid: 14198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607793.339071:0:14198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585ac800, rc 0) 00000100:00100000:2.0:1782607793.339144:0:14198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549bad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e6cd414-a5bd-4223-b33a-76eff85902b7+6:13704:x1869199342412672:12345-192.168.202.4@tcp:101:mount.lustre.0 Request processed in 233us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607793.339151:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 76 00000100:00100000:2.0:1782607793.362438:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607793.362548:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342412800 00000100:00100000:1.0:1782607793.362561:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342412800 00000100:00100000:1.0:1782607793.362629:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 77 00000100:00100000:1.0:1782607793.362639:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549baf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e6cd414-a5bd-4223-b33a-76eff85902b7+6:13704:x1869199342412800:12345-192.168.202.4@tcp:501:mount.lustre.0 00000100:00100000:1.0:1782607793.363091:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549baf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e6cd414-a5bd-4223-b33a-76eff85902b7+6:13704:x1869199342412800:12345-192.168.202.4@tcp:501:mount.lustre.0 Request processed in 451us (666us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782607793.363099:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 77 00000100:00100000:1.0:1782607793.370597:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607793.370701:0:14198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342412928 00000100:00100000:2.0:1782607793.370711:0:14198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342412928 00000100:00100000:2.0:1782607793.370808:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 78 00000100:00100000:2.0:1782607793.370818:0:14198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549baf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e6cd414-a5bd-4223-b33a-76eff85902b7+6:13704:x1869199342412928:12345-192.168.202.4@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782607793.370836:0:14198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607793.370883:0:14198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9745585ac200/0x8109266df35cc4e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a780b5862a0007d expref: -99 pid: 14198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607793.370914:0:14198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9745585ac200/0x8109266df35cc4e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0007d expref: 7 pid: 14198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607793.370927:0:14198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9745585ac200/0x8109266df35cc4e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0007d expref: 7 pid: 14198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607793.370938:0:14198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585ac200, rc 0) 00000100:00100000:2.0:1782607793.371008:0:14198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549baf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e6cd414-a5bd-4223-b33a-76eff85902b7+7:13704:x1869199342412928:12345-192.168.202.4@tcp:101:mount.lustre.0 Request processed in 191us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607793.371014:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 78 00000100:00100000:3.0:1782607793.375683:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607793.376185:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342413056 00000100:00100000:1.0:1782607793.376197:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342413056 00000100:00100000:1.0:1782607793.376261:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 79 00000100:00100000:1.0:1782607793.376272:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549bad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e6cd414-a5bd-4223-b33a-76eff85902b7+7:13704:x1869199342413056:12345-192.168.202.4@tcp:501:mount.lustre.0 00000100:00100000:1.0:1782607793.378683:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549bad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e6cd414-a5bd-4223-b33a-76eff85902b7+8:13704:x1869199342413056:12345-192.168.202.4@tcp:501:mount.lustre.0 Request processed in 2401us (3002us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607793.378698:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 79 00000100:00100000:3.0:1782607793.396420:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607793.396583:0:14199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342413184 00000100:00100000:0.0:1782607793.396594:0:14199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342413184 00000100:00100000:0.0:1782607793.396668:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 80 00000100:00100000:0.0:1782607793.396679:0:14199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549bad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e6cd414-a5bd-4223-b33a-76eff85902b7+8:13704:x1869199342413184:12345-192.168.202.4@tcp:503:mount.lustre.0 00000100:00100000:0.0:1782607793.397149:0:14199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549bad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e6cd414-a5bd-4223-b33a-76eff85902b7+8:13704:x1869199342413184:12345-192.168.202.4@tcp:503:mount.lustre.0 Request processed in 471us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607793.397158:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 80 00000100:00100000:2.0:1782607793.405417:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607793.410237:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342413312 00000100:00100000:1.0:1782607793.410259:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342413312 00000100:00100000:1.0:1782607793.410340:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 81 00000100:00100000:1.0:1782607793.410350:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549bac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e6cd414-a5bd-4223-b33a-76eff85902b7+8:13722:x1869199342413312:12345-192.168.202.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782607793.410717:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549bac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e6cd414-a5bd-4223-b33a-76eff85902b7+8:13722:x1869199342413312:12345-192.168.202.4@tcp:502:llog_process_th.0 Request processed in 367us (5308us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607793.410726:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 81 00000100:00100000:3.0:1782607793.451336:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607793.452570:0:14198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342413440 00000100:00100000:2.0:1782607793.452582:0:14198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342413440 00000100:00100000:2.0:1782607793.452661:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 82 00000100:00100000:2.0:1782607793.452672:0:14198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745770b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e6cd414-a5bd-4223-b33a-76eff85902b7+8:13722:x1869199342413440:12345-192.168.202.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782607793.453021:0:14198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745770b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e6cd414-a5bd-4223-b33a-76eff85902b7+8:13722:x1869199342413440:12345-192.168.202.4@tcp:502:llog_process_th.0 Request processed in 350us (1694us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607793.453030:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 82 00000100:00100000:3.0:1782607793.482448:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607793.482727:0:14199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342413568 00000100:00100000:0.0:1782607793.482737:0:14199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342413568 00000100:00100000:0.0:1782607793.482829:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 83 00000100:00100000:0.0:1782607793.482840:0:14199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745770b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e6cd414-a5bd-4223-b33a-76eff85902b7+8:13704:x1869199342413568:12345-192.168.202.4@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782607793.482860:0:14199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607793.482879:0:14199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974442877400/0x8109266df35cc4ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a780b5862a000a7 expref: -99 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607793.482913:0:14199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974442877400/0x8109266df35cc4ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a000a7 expref: 9 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607793.482927:0:14199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974442877400/0x8109266df35cc4ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a000a7 expref: 9 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607793.482937:0:14199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974442877400, rc 0) 00000100:00100000:0.0:1782607793.482996:0:14199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745770b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e6cd414-a5bd-4223-b33a-76eff85902b7+9:13704:x1869199342413568:12345-192.168.202.4@tcp:101:mount.lustre.0 Request processed in 158us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607793.483003:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 83 00000100:00100000:3.0:1782607793.492445:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607793.492560:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342413696 00000100:00100000:1.0:1782607793.492572:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342413696 00000100:00100000:1.0:1782607793.492632:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 84 00000100:00100000:1.0:1782607793.492642:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745770b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e6cd414-a5bd-4223-b33a-76eff85902b7+9:13704:x1869199342413696:12345-192.168.202.4@tcp:256:mount.lustre.0 20000000:01000000:1.0:1782607793.492669:0:14197:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1782607793.492689:0:14197:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1782607793.492693:0:14197:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1782607793.492697:0:14197:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1782607793.492699:0:14197:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1782607793.500221:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745770b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e6cd414-a5bd-4223-b33a-76eff85902b7+9:13704:x1869199342413696:12345-192.168.202.4@tcp:256:mount.lustre.0 Request processed in 7566us (7774us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607793.500238:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 84 00000100:00100000:3.0:1782607793.511434:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607793.511530:0:14198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342413824 00000100:00100000:2.0:1782607793.511542:0:14198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342413824 00000100:00100000:2.0:1782607793.511603:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 85 00000100:00100000:2.0:1782607793.511614:0:14198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745770b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e6cd414-a5bd-4223-b33a-76eff85902b7+9:13704:x1869199342413824:12345-192.168.202.4@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782607793.511634:0:14198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607793.511653:0:14198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9745585ac600/0x8109266df35cc4f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a780b5862a000ae expref: -99 pid: 14198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607793.511703:0:14198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9745585ac600/0x8109266df35cc4f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a000ae expref: 10 pid: 14198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607793.511714:0:14198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9745585ac600/0x8109266df35cc4f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a000ae expref: 10 pid: 14198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607793.511724:0:14198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585ac600, rc 0) 00000100:00100000:2.0:1782607793.511811:0:14198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745770b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e6cd414-a5bd-4223-b33a-76eff85902b7+10:13704:x1869199342413824:12345-192.168.202.4@tcp:101:mount.lustre.0 Request processed in 198us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607793.511818:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 85 00000100:00100000:3.0:1782607793.522199:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607793.522353:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342413952 00000100:00100000:1.0:1782607793.522364:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342413952 00000100:00100000:1.0:1782607793.522425:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 86 00000100:00100000:1.0:1782607793.522437:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745770b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e6cd414-a5bd-4223-b33a-76eff85902b7+10:13704:x1869199342413952:12345-192.168.202.4@tcp:501:mount.lustre.0 00000100:00100000:1.0:1782607793.522745:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745770b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e6cd414-a5bd-4223-b33a-76eff85902b7+10:13704:x1869199342413952:12345-192.168.202.4@tcp:501:mount.lustre.0 Request processed in 309us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607793.522753:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 86 00000100:00100000:3.0:1782607793.529266:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607793.530302:0:14199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342414080 00000100:00100000:0.0:1782607793.530315:0:14199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342414080 00000100:00100000:0.0:1782607793.530383:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 87 00000100:00100000:0.0:1782607793.530393:0:14199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745770b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e6cd414-a5bd-4223-b33a-76eff85902b7+10:13704:x1869199342414080:12345-192.168.202.4@tcp:503:mount.lustre.0 00000100:00100000:0.0:1782607793.530818:0:14199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745770b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e6cd414-a5bd-4223-b33a-76eff85902b7+10:13704:x1869199342414080:12345-192.168.202.4@tcp:503:mount.lustre.0 Request processed in 426us (1562us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607793.530826:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 87 00000100:00100000:3.0:1782607793.538207:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607793.538302:0:14198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342414208 00000100:00100000:2.0:1782607793.538314:0:14198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342414208 00000100:00100000:2.0:1782607793.538379:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 88 00000100:00100000:2.0:1782607793.538389:0:14198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745770b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e6cd414-a5bd-4223-b33a-76eff85902b7+10:13727:x1869199342414208:12345-192.168.202.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782607793.538688:0:14198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745770b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e6cd414-a5bd-4223-b33a-76eff85902b7+10:13727:x1869199342414208:12345-192.168.202.4@tcp:502:llog_process_th.0 Request processed in 299us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607793.538696:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 88 00000100:00100000:3.0:1782607793.543940:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607793.544051:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342414336 00000100:00100000:1.0:1782607793.544062:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342414336 00000100:00100000:1.0:1782607793.544125:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 89 00000100:00100000:1.0:1782607793.544136:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745770b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e6cd414-a5bd-4223-b33a-76eff85902b7+10:13727:x1869199342414336:12345-192.168.202.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782607793.544410:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745770b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e6cd414-a5bd-4223-b33a-76eff85902b7+10:13727:x1869199342414336:12345-192.168.202.4@tcp:502:llog_process_th.0 Request processed in 275us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607793.544418:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 89 00000100:00100000:3.0:1782607793.548824:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607793.548916:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342414464 00000100:00100000:0.0:1782607793.548927:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342414464 00000100:00100000:0.0:1782607793.548983:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4 00000100:00100000:0.0:1782607793.549008:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2353:x1869199342414464:12345-192.168.202.4@tcp:38:mount.lustre.0 00010000:00080000:0.0:1782607793.549043:0:14206:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 32e35a33-83b5-4007-97ba-302ed8efa50a@192.168.202.4@tcp t0 exp 0000000000000000 cur 452 last 0 00000020:00000080:0.0:1782607793.549112:0:14206:0:(genops.c:1406:class_connect()) connect: client 32e35a33-83b5-4007-97ba-302ed8efa50a, cookie 0x8109266df35cc4f8 00000004:00100000:0.0:1782607793.549143:0:14206:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1782607793.549149:0:14206:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1782607793.602313:0:14206:0:(import.c:65:import_set_state_nolock()) ffff974577c1a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782607793.602404:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32e35a33-83b5-4007-97ba-302ed8efa50a+6:2353:x1869199342414464:12345-192.168.202.4@tcp:38:mount.lustre.0 Request processed in 53395us (53590us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607793.602416:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4 00000100:00100000:3.0:1782607793.604887:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607793.604929:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607793.605124:0:14205:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342414720 00000100:00100000:0.0:1782607793.605134:0:14205:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342414720 00000100:00100000:0.0:1782607793.605208:0:14205:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342414592 00000100:00100000:0.0:1782607793.605212:0:14205:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342414592 00000100:00100000:0.0:1782607793.605228:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5 00000100:00100000:0.0:1782607793.605236:0:14205:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97444336bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+7:13704:x1869199342414720:12345-192.168.202.4@tcp:41:mount.lustre.0 00000004:00000024:0.0:1782607793.605278:0:14205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1782607793.605352:0:14205:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97444336bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+7:13704:x1869199342414720:12345-192.168.202.4@tcp:41:mount.lustre.0 Request processed in 116us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607793.605359:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5 00000100:00100000:0.0:1782607793.605376:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 6 00000100:00100000:0.0:1782607793.605382:0:14205:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97444336a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+6:0:x1869199342414592:12345-192.168.202.4@tcp:41:mount.lustre.0 00000004:00000024:0.0:1782607793.605393:0:14205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1782607793.605413:0:14205:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97444336a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+6:0:x1869199342414592:12345-192.168.202.4@tcp:41:mount.lustre.0 Request processed in 31us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607793.605419:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 6 00000100:00080000:1.0:1782607793.605501:0:14200:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782607793.611649:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607793.614984:0:14205:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342414848 00000100:00100000:0.0:1782607793.614998:0:14205:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342414848 00000100:00100000:0.0:1782607793.615066:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7 00000100:00100000:0.0:1782607793.615078:0:14205:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f40f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+6:13704:x1869199342414848:12345-192.168.202.4@tcp:40:mount.lustre.0 00000100:00100000:0.0:1782607793.615186:0:14205:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f40f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+6:13704:x1869199342414848:12345-192.168.202.4@tcp:40:mount.lustre.0 Request processed in 102us (3537us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607793.615194:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7 00000100:00100000:3.0:1782607793.618622:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607793.618879:0:14840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342414976 00000100:00100000:2.0:1782607793.618889:0:14840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342414976 00000100:00100000:2.0:1782607793.618936:0:14840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8 00000100:00100000:2.0:1782607793.618944:0:14840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443368000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1869199342414976:12345-192.168.202.4@tcp:8:mount.lustre.0 00010000:00080000:2.0:1782607793.618974:0:14840:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 32e35a33-83b5-4007-97ba-302ed8efa50a@192.168.202.4@tcp t0 exp 0000000000000000 cur 452 last 0 00000020:00000080:2.0:1782607793.619004:0:14840:0:(genops.c:1406:class_connect()) connect: client 32e35a33-83b5-4007-97ba-302ed8efa50a, cookie 0x8109266df35cc4ff 00002000:00100000:2.0:1782607793.619017:0:14840:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 32e35a33-83b5-4007-97ba-302ed8efa50a/ffff97456a54e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782607793.619042:0:14840:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1782607793.619405:0:14840:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1782607793.619446:0:14840:0:(import.c:65:import_set_state_nolock()) ffff97456a54a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782607793.619525:0:14840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443368000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:32e35a33-83b5-4007-97ba-302ed8efa50a+6:2353:x1869199342414976:12345-192.168.202.4@tcp:8:mount.lustre.0 Request processed in 580us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607793.619532:0:14840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8 00000100:00100000:3.0:1782607793.622289:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607793.622408:0:14838:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342415104 00000100:00100000:0.0:1782607793.622419:0:14838:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342415104 00000100:00100000:0.0:1782607793.622464:0:14838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 9 00000100:00100000:0.0:1782607793.622472:0:14838:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1869199342415104:12345-192.168.202.4@tcp:8:mount.lustre.0 00010000:00080000:0.0:1782607793.622505:0:14838:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 32e35a33-83b5-4007-97ba-302ed8efa50a@192.168.202.4@tcp t0 exp 0000000000000000 cur 452 last 0 00000020:00000080:0.0:1782607793.622541:0:14838:0:(genops.c:1406:class_connect()) connect: client 32e35a33-83b5-4007-97ba-302ed8efa50a, cookie 0x8109266df35cc506 00002000:00100000:0.0:1782607793.622553:0:14838:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 32e35a33-83b5-4007-97ba-302ed8efa50a/ffff974551165000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782607793.622579:0:14838:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1782607793.622811:0:14838:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1782607793.622838:0:14838:0:(import.c:65:import_set_state_nolock()) ffff974551167000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782607793.622902:0:14838:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:32e35a33-83b5-4007-97ba-302ed8efa50a+6:2353:x1869199342415104:12345-192.168.202.4@tcp:8:mount.lustre.0 Request processed in 429us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607793.622910:0:14838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 9 00000100:00100000:3.0:1782607793.626243:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607793.626442:0:14207:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342415232 00000100:00100000:2.0:1782607793.626451:0:14207:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342415232 00000100:00100000:2.0:1782607793.626504:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 0 00000100:00100000:2.0:1782607793.626514:0:14207:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:32e35a33-83b5-4007-97ba-302ed8efa50a+6:13704:x1869199342415232:12345-192.168.202.4@tcp:33:mount.lustre.0 00000004:00080000:2.0:1782607793.628037:0:14207:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1457us 00000004:00200000:1.0:1782607793.643047:0:14207:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1782607793.643245:0:14207:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:32e35a33-83b5-4007-97ba-302ed8efa50a+6:13704:x1869199342415232:12345-192.168.202.4@tcp:33:mount.lustre.0 Request processed in 16724us (17005us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607793.643270:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 0 00000100:00100000:3.0:1782607793.895523:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607793.895626:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342415360 00000100:00100000:0.0:1782607793.895636:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342415360 00000100:00100000:0.0:1782607793.895696:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8 00000100:00100000:0.0:1782607793.895705:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97444336a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32e35a33-83b5-4007-97ba-302ed8efa50a+6:13748:x1869199342415360:12345-192.168.202.4@tcp:101:mkdir.0 00010000:00010000:0.0:1782607793.895725:0:14206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607793.895801:0:14206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974442876800/0x8109266df35cc50d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b5862a000d8 expref: -99 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607793.895876:0:14206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974442876000/0x8109266df35cc514 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607793.895890:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974442876000/0x8109266df35cc514 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607793.895903:0:14206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974442876000/0x8109266df35cc514 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782607793.896105:0:14206:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782607793.896109:0:14206:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1782607793.896190:0:14206:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff974442876000/0x8109266df35cc514 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607793.896218:0:14206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974442876800/0x8109266df35cc50d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a000d8 expref: 8 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607793.896236:0:14206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974442876000/0x8109266df35cc514 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a000d8 expref: 7 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607793.896245:0:14206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff974543e72500) 00010000:00010000:0.0:1782607793.896248:0:14206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782607793.896251:0:14206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974442876000, rc 0) 00000100:00100000:0.0:1782607793.896541:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97444336a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32e35a33-83b5-4007-97ba-302ed8efa50a+7:13748:x1869199342415360:12345-192.168.202.4@tcp:101:mkdir.0 Request processed in 610us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607793.896547:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8 00010000:00010000:0.0:1782607794.178008:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607794.242412:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364430464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782607794.242492:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607794.242585:0:14842:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364430464 00000100:00100000:1.0:1782607794.242593:0:14842:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364430464 00000100:00100000:1.0:1782607794.242653:0:14842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782607794.242663:0:14842:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f40ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3319:x1869199364430464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782607794.242687:0:14842:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782607794.242759:0:14842:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f40ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3319:x1869199364430464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607794.242791:0:14842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1782607794.242818:0:14200:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782607794.242826:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364430464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782607794.243623:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97444336b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33f55b46-a882-437e-a0a1-2be6832a7ec1:3316:1869199364430592:0@lo:400:kworker.0 00000100:00100000:2.0:1782607794.243850:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974443369880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364430720:0@lo:400:kworker.0 00000100:00100000:2.0:1782607794.247061:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607794.247330:0:14839:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364430720 00000100:00100000:2.0:1782607794.247339:0:14839:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364430720 00000100:00100000:2.0:1782607794.247401:0:14839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782607794.247411:0:14839:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974577609880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364430720:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1782607794.247857:0:14200:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782607794.248050:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97444336ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3319:1869199364430976:0@lo:400:kworker.0 00000100:00100000:1.0:1782607794.249401:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607794.249442:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782607794.249454:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974443368700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1869199364430848:0@lo:400:kworker.0 00000100:00100000:1.0:1782607794.249480:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607794.252970:0:14205:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364430976 00000100:00100000:0.0:1782607794.252986:0:14205:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364430976 00000100:00100000:0.0:1782607794.253054:0:14205:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364430848 00000100:00100000:0.0:1782607794.253058:0:14205:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364430848 00000100:00100000:0.0:1782607794.253078:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782607794.253086:0:14205:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f40c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1869199364430976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607794.253193:0:14205:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f40c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1869199364430976:12345-0@lo:400:kworker.0 Request processed in 108us (3795us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607794.253201:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782607794.253217:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782607794.253223:0:14205:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f40ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1869199364430848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607794.253258:0:14205:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f40ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1869199364430848:12345-0@lo:400:kworker.0 Request processed in 34us (3775us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607794.253265:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1782607794.253289:0:14200:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782607794.253327:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974443368700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1869199364430848:0@lo:400:kworker.0 00000100:00100000:0.0:1782607794.253343:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97444336ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3319:1869199364430976:0@lo:400:kworker.0 00000100:00100000:3.0:1782607794.260109:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607794.260372:0:14199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364430592 00000100:00100000:3.0:1782607794.260382:0:14199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364430592 00000100:00100000:3.0:1782607794.260433:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1782607794.260442:0:14199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745770b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+19:3316:x1869199364430592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607794.260518:0:14199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745770b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+19:3316:x1869199364430592:12345-0@lo:400:kworker.0 Request processed in 77us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607794.260525:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1782607794.260589:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97444336b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33f55b46-a882-437e-a0a1-2be6832a7ec1:3316:1869199364430592:0@lo:400:kworker.0 00000100:00100000:3.0:1782607794.260599:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974443369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1869199364431104:0@lo:400:kworker.0 00000100:00100000:3.0:1782607794.260630:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607794.260681:0:14205:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364431104 00000100:00100000:3.0:1782607794.260684:0:14205:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364431104 00000100:00100000:3.0:1782607794.260713:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782607794.260718:0:14205:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97444336ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869199364431104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607794.260758:0:14205:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97444336ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869199364431104:12345-0@lo:400:kworker.0 Request processed in 40us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607794.260791:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1782607794.260807:0:14200:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782607794.260829:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974443369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1869199364431104:0@lo:400:kworker.0 00000100:00100000:2.0:1782607794.265362:0:14839:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974577609880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364430720:12345-0@lo:400:kworker.0 Request processed in 17943us (18298us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607794.265378:0:14839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782607794.265443:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974443369880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364430720:0@lo:400:kworker.0 00000001:00100000:3.0:1782607794.313799:0:7525:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 32e35a33-83b5-4007-97ba-302ed8efa50a 00000001:00080000:3.0:1782607794.313823:0:7525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1782607794.313868:0:7525:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1782607795.201946:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1782607795.302556:0:6634:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 32e35a33-83b5-4007-97ba-302ed8efa50a 00000100:00100000:3.0:1782607795.897700:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607795.898571:0:14205:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342415488 00000100:00100000:0.0:1782607795.898592:0:14205:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342415488 00000100:00100000:0.0:1782607795.898683:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 9 00000100:00100000:0.0:1782607795.898694:0:14205:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+7:13800:x1869199342415488:12345-192.168.202.4@tcp:41:lfs.0 00000100:00080000:3.0:1782607795.898734:0:14200:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:0.0:1782607795.898746:0:14205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1782607795.898895:0:14205:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+7:13800:x1869199342415488:12345-192.168.202.4@tcp:41:lfs.0 Request processed in 202us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607795.898903:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 9 00000100:00100000:3.0:1782607795.902431:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607795.902716:0:14841:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342415616 00000100:00100000:2.0:1782607795.902745:0:14841:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342415616 00000100:00100000:2.0:1782607795.902895:0:14841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5 00000100:00100000:2.0:1782607795.902907:0:14841:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97444336b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:32e35a33-83b5-4007-97ba-302ed8efa50a+5:13800:x1869199342415616:12345-192.168.202.4@tcp:13:lfs.0 00002000:00000024:2.0:1782607795.902962:0:14841:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782607795.903078:0:14841:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97444336b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:32e35a33-83b5-4007-97ba-302ed8efa50a+5:13800:x1869199342415616:12345-192.168.202.4@tcp:13:lfs.0 Request processed in 172us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607795.903086:0:14841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5 00000100:00080000:3.0:1782607795.908532:0:14200:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782607795.908854:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607795.909088:0:14841:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342415744 00000100:00100000:3.0:1782607795.909103:0:14841:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342415744 00000100:00100000:3.0:1782607795.909218:0:14841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 6 00000100:00100000:3.0:1782607795.909234:0:14841:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549e7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:32e35a33-83b5-4007-97ba-302ed8efa50a+5:13800:x1869199342415744:12345-192.168.202.4@tcp:13:lfs.0 00002000:00000024:3.0:1782607795.909295:0:14841:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782607795.909403:0:14841:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549e7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:32e35a33-83b5-4007-97ba-302ed8efa50a+5:13800:x1869199342415744:12345-192.168.202.4@tcp:13:lfs.0 Request processed in 173us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607795.909412:0:14841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 6 00000100:00080000:0.0:1782607795.910063:0:14200:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782607796.142854:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607796.143069:0:14198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342415872 00000100:00100000:2.0:1782607796.143083:0:14198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342415872 00000100:00100000:2.0:1782607796.143173:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 91 00000100:00100000:2.0:1782607796.143189:0:14198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745770b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e6cd414-a5bd-4223-b33a-76eff85902b7+10:13833:x1869199342415872:12345-192.168.202.4@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782607796.143215:0:14198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607796.143241:0:14198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9745585ad400/0x8109266df35cc51b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a780b5862a000df expref: -99 pid: 14198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607796.143285:0:14198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9745585ad400/0x8109266df35cc51b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a000df expref: 11 pid: 14198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607796.143298:0:14198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9745585ad400/0x8109266df35cc51b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a000df expref: 11 pid: 14198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607796.143310:0:14198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585ad400, rc 0) 00000100:00100000:2.0:1782607796.143397:0:14198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745770b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e6cd414-a5bd-4223-b33a-76eff85902b7+11:13833:x1869199342415872:12345-192.168.202.4@tcp:101:mount.lustre.0 Request processed in 211us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607796.143406:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 91 00000100:00100000:3.0:1782607796.151064:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607796.151169:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342416000 00000100:00100000:1.0:1782607796.151185:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342416000 00000100:00100000:1.0:1782607796.151271:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 92 00000100:00100000:1.0:1782607796.151285:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745770b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e6cd414-a5bd-4223-b33a-76eff85902b7+11:13833:x1869199342416000:12345-192.168.202.4@tcp:501:mount.lustre.0 00000100:00100000:1.0:1782607796.151992:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745770b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e6cd414-a5bd-4223-b33a-76eff85902b7+11:13833:x1869199342416000:12345-192.168.202.4@tcp:501:mount.lustre.0 Request processed in 706us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607796.152002:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 92 00000100:00100000:0.0:1782607796.165900:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607796.166599:0:14199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342416128 00000100:00100000:3.0:1782607796.166613:0:14199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342416128 00000100:00100000:3.0:1782607796.166682:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 93 00000100:00100000:3.0:1782607796.166693:0:14199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745770b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e6cd414-a5bd-4223-b33a-76eff85902b7+11:13833:x1869199342416128:12345-192.168.202.4@tcp:503:mount.lustre.0 00000100:00100000:3.0:1782607796.167104:0:14199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745770b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e6cd414-a5bd-4223-b33a-76eff85902b7+11:13833:x1869199342416128:12345-192.168.202.4@tcp:503:mount.lustre.0 Request processed in 410us (1218us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607796.167123:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 93 00000100:00100000:0.0:1782607796.185217:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607796.185656:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342416256 00000100:00100000:1.0:1782607796.185669:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342416256 00000100:00100000:1.0:1782607796.185746:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 94 00000100:00100000:1.0:1782607796.185760:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745770b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e6cd414-a5bd-4223-b33a-76eff85902b7+11:13839:x1869199342416256:12345-192.168.202.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782607796.186280:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745770b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e6cd414-a5bd-4223-b33a-76eff85902b7+11:13839:x1869199342416256:12345-192.168.202.4@tcp:502:llog_process_th.0 Request processed in 522us (1078us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607796.186291:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 94 00000100:00100000:0.0:1782607796.225019:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607796.225214:0:14198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342416384 00000100:00100000:2.0:1782607796.225230:0:14198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342416384 00000100:00100000:2.0:1782607796.225310:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 95 00000100:00100000:2.0:1782607796.225350:0:14198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745770b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e6cd414-a5bd-4223-b33a-76eff85902b7+11:13839:x1869199342416384:12345-192.168.202.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782607796.229312:0:14198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745770b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e6cd414-a5bd-4223-b33a-76eff85902b7+11:13839:x1869199342416384:12345-192.168.202.4@tcp:502:llog_process_th.0 Request processed in 3949us (4292us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607796.229333:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 95 00010000:00010000:3.0:1782607796.229808:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782607796.232058:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607796.232217:0:14199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342416512 00000100:00100000:3.0:1782607796.232230:0:14199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342416512 00000100:00100000:3.0:1782607796.232308:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 96 00000100:00100000:3.0:1782607796.232319:0:14199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745770b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e6cd414-a5bd-4223-b33a-76eff85902b7+11:13833:x1869199342416512:12345-192.168.202.4@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782607796.232344:0:14199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607796.232369:0:14199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97455d648a00/0x8109266df35cc522 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a780b5862a00109 expref: -99 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607796.232422:0:14199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97455d648a00/0x8109266df35cc522 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00109 expref: 12 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607796.232435:0:14199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97455d648a00/0x8109266df35cc522 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00109 expref: 12 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607796.232446:0:14199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97455d648a00, rc 0) 00000100:00100000:3.0:1782607796.232528:0:14199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745770b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e6cd414-a5bd-4223-b33a-76eff85902b7+12:13833:x1869199342416512:12345-192.168.202.4@tcp:101:mount.lustre.0 Request processed in 209us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607796.232536:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 96 00000100:00100000:0.0:1782607796.240681:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607796.240859:0:14198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342416640 00000100:00100000:2.0:1782607796.240873:0:14198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342416640 00000100:00100000:2.0:1782607796.240959:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 97 00000100:00100000:2.0:1782607796.240972:0:14198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745770b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e6cd414-a5bd-4223-b33a-76eff85902b7+12:13833:x1869199342416640:12345-192.168.202.4@tcp:256:mount.lustre.0 20000000:01000000:2.0:1782607796.241009:0:14198:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1782607796.241054:0:14198:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1782607796.241059:0:14198:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1782607796.241063:0:14198:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1782607796.241066:0:14198:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1782607796.243740:0:14198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745770b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e6cd414-a5bd-4223-b33a-76eff85902b7+12:13833:x1869199342416640:12345-192.168.202.4@tcp:256:mount.lustre.0 Request processed in 2754us (3061us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607796.243758:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 97 00000100:00100000:0.0:1782607796.247937:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607796.248145:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342416768 00000100:00100000:1.0:1782607796.248168:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342416768 00000100:00100000:1.0:1782607796.248243:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 98 00000100:00100000:1.0:1782607796.248257:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f5a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e6cd414-a5bd-4223-b33a-76eff85902b7+12:13833:x1869199342416768:12345-192.168.202.4@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782607796.248280:0:14197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607796.248304:0:14197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974571007c00/0x8109266df35cc529 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a780b5862a00110 expref: -99 pid: 14197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607796.248345:0:14197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974571007c00/0x8109266df35cc529 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00110 expref: 13 pid: 14197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607796.248360:0:14197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974571007c00/0x8109266df35cc529 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00110 expref: 13 pid: 14197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607796.248374:0:14197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974571007c00, rc 0) 00000100:00100000:1.0:1782607796.248467:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f5a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e6cd414-a5bd-4223-b33a-76eff85902b7+13:13833:x1869199342416768:12345-192.168.202.4@tcp:101:mount.lustre.0 Request processed in 212us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607796.248494:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 98 00000100:00100000:0.0:1782607796.251699:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607796.252017:0:14198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342416896 00000100:00100000:2.0:1782607796.252029:0:14198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342416896 00000100:00100000:2.0:1782607796.252107:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 99 00000100:00100000:2.0:1782607796.252119:0:14198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f5a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e6cd414-a5bd-4223-b33a-76eff85902b7+13:13833:x1869199342416896:12345-192.168.202.4@tcp:501:mount.lustre.0 00000100:00100000:2.0:1782607796.252523:0:14198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f5a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e6cd414-a5bd-4223-b33a-76eff85902b7+13:13833:x1869199342416896:12345-192.168.202.4@tcp:501:mount.lustre.0 Request processed in 405us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607796.252533:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 99 00000100:00100000:0.0:1782607796.254575:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607796.254974:0:14199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342417024 00000100:00100000:3.0:1782607796.254987:0:14199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342417024 00000100:00100000:3.0:1782607796.255067:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 100 00000100:00100000:3.0:1782607796.255081:0:14199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f5a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e6cd414-a5bd-4223-b33a-76eff85902b7+13:13833:x1869199342417024:12345-192.168.202.4@tcp:503:mount.lustre.0 00000100:00100000:3.0:1782607796.255454:0:14199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f5a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e6cd414-a5bd-4223-b33a-76eff85902b7+13:13833:x1869199342417024:12345-192.168.202.4@tcp:503:mount.lustre.0 Request processed in 376us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607796.255475:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 100 00000100:00100000:0.0:1782607796.258730:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607796.258883:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342417152 00000100:00100000:1.0:1782607796.258898:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342417152 00000100:00100000:1.0:1782607796.258974:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 101 00000100:00100000:1.0:1782607796.258986:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f5a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e6cd414-a5bd-4223-b33a-76eff85902b7+13:13842:x1869199342417152:12345-192.168.202.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782607796.259353:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f5a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e6cd414-a5bd-4223-b33a-76eff85902b7+13:13842:x1869199342417152:12345-192.168.202.4@tcp:502:llog_process_th.0 Request processed in 367us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607796.259362:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 101 00000100:00100000:0.0:1782607796.262705:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607796.262855:0:14198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342417280 00000100:00100000:2.0:1782607796.262869:0:14198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342417280 00000100:00100000:2.0:1782607796.262945:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 102 00000100:00100000:2.0:1782607796.262972:0:14198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f5a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e6cd414-a5bd-4223-b33a-76eff85902b7+13:13842:x1869199342417280:12345-192.168.202.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782607796.263302:0:14198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f5a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e6cd414-a5bd-4223-b33a-76eff85902b7+13:13842:x1869199342417280:12345-192.168.202.4@tcp:502:llog_process_th.0 Request processed in 332us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607796.263310:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 102 00000100:00100000:0.0:1782607796.266145:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607796.266212:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607796.266252:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607796.266282:0:14840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342417920 00000100:00100000:0.0:1782607796.266293:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607796.266295:0:14840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342417920 00000100:00100000:1.0:1782607796.266372:0:14838:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342418048 00000100:00100000:1.0:1782607796.266377:0:14838:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342418048 00000100:00100000:3.0:1782607796.266399:0:14840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 3 00000100:00100000:3.0:1782607796.266414:0:14840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549e7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:32e35a33-83b5-4007-97ba-302ed8efa50a+5:2356:x1869199342417920:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1782607796.266418:0:14838:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1782607796.266431:0:14838:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1782607796.266517:0:14840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549e7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:32e35a33-83b5-4007-97ba-302ed8efa50a+5:2356:x1869199342417920:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 106us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607796.266525:0:14840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 3 00000100:00100000:3.0:1782607796.266546:0:14840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4 00000100:00100000:3.0:1782607796.266553:0:14840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:32e35a33-83b5-4007-97ba-302ed8efa50a+5:2356:x1869199342418048:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1782607796.266582:0:14840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:32e35a33-83b5-4007-97ba-302ed8efa50a+5:2356:x1869199342418048:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 30us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607796.266589:0:14840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4 00000100:00100000:1.0:1782607796.266631:0:14205:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342417408 00000100:00100000:1.0:1782607796.266637:0:14205:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342417408 00000100:00100000:1.0:1782607796.266663:0:14205:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342417792 00000100:00100000:1.0:1782607796.266666:0:14205:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342417792 00000100:00100000:1.0:1782607796.266689:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16 00000100:00100000:1.0:1782607796.266699:0:14205:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549e7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+7:2356:x1869199342417792:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1782607796.266748:0:14205:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549e7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+7:2356:x1869199342417792:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 51us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607796.266752:0:14206:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1782607796.266760:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16 00000100:00100000:3.0:1782607796.266761:0:14206:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1782607796.266805:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 10 00000100:00100000:1.0:1782607796.266812:0:14205:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974549e7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2353:x1869199342417408:12345-192.168.202.4@tcp:38:mount.lustre.0 00010000:00080000:1.0:1782607796.266839:0:14205:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 0b859eba-a064-4697-844f-1f4595f38a4c@192.168.202.4@tcp t0 exp 0000000000000000 cur 455 last 0 00000020:00000080:1.0:1782607796.266879:0:14205:0:(genops.c:1406:class_connect()) connect: client 0b859eba-a064-4697-844f-1f4595f38a4c, cookie 0x8109266df35cc530 00000004:00100000:1.0:1782607796.266934:0:14205:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1782607796.267108:0:14205:0:(import.c:65:import_set_state_nolock()) ffff974442b3e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782607796.267169:0:14205:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974549e7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b859eba-a064-4697-844f-1f4595f38a4c+6:2353:x1869199342417408:12345-192.168.202.4@tcp:38:mount.lustre.0 Request processed in 343us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607796.267177:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 10 00000100:00100000:3.0:1782607796.270287:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607796.270392:0:14205:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342417536 00000100:00100000:1.0:1782607796.270415:0:14205:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342417536 00000100:00100000:1.0:1782607796.270510:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11 00000100:00100000:1.0:1782607796.270523:0:14205:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b859eba-a064-4697-844f-1f4595f38a4c+6:0:x1869199342417536:12345-192.168.202.4@tcp:41:mount.lustre.0 00000004:00000024:1.0:1782607796.270585:0:14205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1782607796.270688:0:14205:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b859eba-a064-4697-844f-1f4595f38a4c+6:0:x1869199342417536:12345-192.168.202.4@tcp:41:mount.lustre.0 Request processed in 167us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607796.270696:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11 00000100:00080000:0.0:1782607796.271104:0:14200:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782607796.274455:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607796.274616:0:15978:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342417664 00000100:00100000:2.0:1782607796.274632:0:15978:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342417664 00000100:00100000:2.0:1782607796.274720:0:15978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 12 00000100:00100000:2.0:1782607796.274734:0:15978:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f40df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b859eba-a064-4697-844f-1f4595f38a4c+6:13833:x1869199342417664:12345-192.168.202.4@tcp:41:mount.lustre.0 00000004:00000024:2.0:1782607796.274814:0:15978:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1782607796.274918:0:15978:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f40df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b859eba-a064-4697-844f-1f4595f38a4c+6:13833:x1869199342417664:12345-192.168.202.4@tcp:41:mount.lustre.0 Request processed in 187us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607796.274938:0:15978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 12 00000100:00100000:2.0:1782607796.292971:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607796.294231:0:14205:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342418176 00000100:00100000:1.0:1782607796.294247:0:14205:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342418176 00000100:00100000:1.0:1782607796.294345:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 13 00000100:00100000:1.0:1782607796.294359:0:14205:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457760ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b859eba-a064-4697-844f-1f4595f38a4c+6:13833:x1869199342418176:12345-192.168.202.4@tcp:40:mount.lustre.0 00000100:00100000:1.0:1782607796.294503:0:14205:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457760ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b859eba-a064-4697-844f-1f4595f38a4c+6:13833:x1869199342418176:12345-192.168.202.4@tcp:40:mount.lustre.0 Request processed in 146us (1556us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607796.294513:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 13 00000100:00100000:2.0:1782607796.305521:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607796.305577:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607796.305623:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607796.305727:0:14840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342418304 00000100:00100000:0.0:1782607796.305741:0:14840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342418304 00000100:00100000:0.0:1782607796.305833:0:14840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342418432 00000100:00100000:0.0:1782607796.305837:0:14840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342418432 00000100:00100000:0.0:1782607796.305859:0:14840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 10 00000100:00100000:0.0:1782607796.305870:0:14840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457760b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1869199342418304:12345-192.168.202.4@tcp:8:mount.lustre.0 00010000:00080000:0.0:1782607796.305917:0:14840:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 0b859eba-a064-4697-844f-1f4595f38a4c@192.168.202.4@tcp t0 exp 0000000000000000 cur 455 last 0 00000020:00000080:0.0:1782607796.305979:0:14840:0:(genops.c:1406:class_connect()) connect: client 0b859eba-a064-4697-844f-1f4595f38a4c, cookie 0x8109266df35cc537 00002000:00100000:0.0:1782607796.305997:0:14840:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0b859eba-a064-4697-844f-1f4595f38a4c/ffff97456a572800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782607796.306014:0:14840:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1782607796.306401:0:14840:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1782607796.306443:0:14840:0:(import.c:65:import_set_state_nolock()) ffff97456a575800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782607796.306544:0:14840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457760b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b859eba-a064-4697-844f-1f4595f38a4c+6:2353:x1869199342418304:12345-192.168.202.4@tcp:8:mount.lustre.0 Request processed in 673us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607796.306554:0:14840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 10 00000100:00100000:0.0:1782607796.306578:0:14840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11 00000100:00100000:0.0:1782607796.306584:0:14840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457760a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1869199342418432:12345-192.168.202.4@tcp:8:mount.lustre.0 00010000:00080000:0.0:1782607796.306602:0:14840:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 0b859eba-a064-4697-844f-1f4595f38a4c@192.168.202.4@tcp t0 exp 0000000000000000 cur 455 last 0 00000020:00000080:0.0:1782607796.306623:0:14840:0:(genops.c:1406:class_connect()) connect: client 0b859eba-a064-4697-844f-1f4595f38a4c, cookie 0x8109266df35cc53e 00002000:00100000:0.0:1782607796.306630:0:14840:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0b859eba-a064-4697-844f-1f4595f38a4c/ffff974580c0e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113669 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782607796.306638:0:14840:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1782607796.306819:0:14840:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1782607796.306838:0:14840:0:(import.c:65:import_set_state_nolock()) ffff974542c04000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782607796.306864:0:14840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457760a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b859eba-a064-4697-844f-1f4595f38a4c+6:2353:x1869199342418432:12345-192.168.202.4@tcp:8:mount.lustre.0 Request processed in 279us (1240us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607796.306871:0:14840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11 00000100:00100000:3.0:1782607796.307521:0:14208:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342418560 00000100:00100000:3.0:1782607796.307529:0:14208:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342418560 00000100:00100000:3.0:1782607796.307585:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1 00000100:00100000:3.0:1782607796.307593:0:14208:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974577609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b859eba-a064-4697-844f-1f4595f38a4c+6:13833:x1869199342418560:12345-192.168.202.4@tcp:33:mount.lustre.0 00000004:00200000:3.0:1782607796.307868:0:14208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1782607796.308208:0:14208:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974577609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b859eba-a064-4697-844f-1f4595f38a4c+6:13833:x1869199342418560:12345-192.168.202.4@tcp:33:mount.lustre.0 Request processed in 615us (2707us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607796.308216:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1 00000100:00100000:2.0:1782607796.474705:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607796.474955:0:15978:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342418688 00000100:00100000:1.0:1782607796.474970:0:15978:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342418688 00000100:00100000:1.0:1782607796.475044:0:15978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 14 00000100:00100000:1.0:1782607796.475054:0:15978:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457760b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b859eba-a064-4697-844f-1f4595f38a4c+6:13863:x1869199342418688:12345-192.168.202.4@tcp:101:mkdir.0 00010000:00010000:1.0:1782607796.475081:0:15978:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607796.475110:0:15978:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974571007e00/0x8109266df35cc545 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b5862a0013a expref: -99 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607796.475228:0:15978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974571007400/0x8109266df35cc54c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607796.475245:0:15978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974571007400/0x8109266df35cc54c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607796.475259:0:15978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974571007400/0x8109266df35cc54c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782607796.475516:0:15978:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1782607796.475520:0:15978:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1782607796.476168:0:15978:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff974571007400/0x8109266df35cc54c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607796.476209:0:15978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974571007e00/0x8109266df35cc545 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0013a expref: 8 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607796.476233:0:15978:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974571007400/0x8109266df35cc54c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0013a expref: 7 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607796.476242:0:15978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff974543e72500) 00010000:00010000:1.0:1782607796.476246:0:15978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782607796.476250:0:15978:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974571007400, rc 0) 00000100:00100000:1.0:1782607796.476375:0:15978:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457760b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b859eba-a064-4697-844f-1f4595f38a4c+7:13863:x1869199342418688:12345-192.168.202.4@tcp:101:mkdir.0 Request processed in 1321us (1684us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607796.476383:0:15978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 14 00010000:00010000:1.0:1782607797.250484:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607797.315246:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782607797.315288:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364431232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782607797.315391:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607797.315480:0:14841:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364431232 00000100:00100000:1.0:1782607797.315490:0:14841:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364431232 00000100:00100000:1.0:1782607797.315565:0:14841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782607797.315578:0:14841:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f40c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364431232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782607797.315699:0:14841:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782607797.315754:0:14841:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f40c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364431232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 177us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607797.315762:0:14841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782607797.315861:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364431232:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782607797.316447:0:14200:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782607798.279918:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782607798.595281:0:14236:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:2.0:1782607798.955164:0:5825:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 32e35a33-83b5-4007-97ba-302ed8efa50a 00000001:00100000:2.0:1782607798.955205:0:5825:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0b859eba-a064-4697-844f-1f4595f38a4c 00010000:00010000:1.0:1782607799.298277:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782607799.362239:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782607799.362278:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364431360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782607799.362381:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607799.362545:0:14841:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364431360 00000100:00100000:1.0:1782607799.362555:0:14841:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364431360 00000100:00080000:0.0:1782607799.362626:0:14200:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782607799.362653:0:14841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782607799.362666:0:14841:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457760b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364431360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782607799.362720:0:14841:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782607799.362818:0:14841:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457760b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364431360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607799.362828:0:14841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782607799.362907:0:3319:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1782607799.362939:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364431360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782607799.363831:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97458100a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364431616:0@lo:400:kworker.0 00000100:00100000:0.0:1782607799.363890:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607799.363923:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782607799.363928:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869199364431744:0@lo:400:kworker.0 00000100:00100000:0.0:1782607799.363953:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607799.364002:0:14840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364431616 00000100:00100000:0.0:1782607799.364009:0:14840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364431616 00000100:00100000:0.0:1782607799.364089:0:14840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782607799.364107:0:14840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581008000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364431616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607799.364171:0:14840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581008000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364431616:12345-0@lo:400:kworker.0 Request processed in 67us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607799.364177:0:14840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782607799.364201:0:14205:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364431744 00000100:00100000:0.0:1782607799.364205:0:14205:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364431744 00000100:00100000:0.0:1782607799.364235:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782607799.364241:0:14205:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458100ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869199364431744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607799.364273:0:14205:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458100ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869199364431744:12345-0@lo:400:kworker.0 Request processed in 32us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607799.364278:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782607799.364304:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97458100bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1869199364431872:0@lo:400:kworker.0 00000100:00100000:0.0:1782607799.364331:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607799.364351:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782607799.364357:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581008a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33f55b46-a882-437e-a0a1-2be6832a7ec1:3318:1869199364431488:0@lo:400:kworker.0 00000100:00100000:0.0:1782607799.364388:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607799.364418:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97458100aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1869199364432000:0@lo:400:kworker.0 00000100:00100000:0.0:1782607799.364438:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607799.364466:0:14204:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364431872 00000100:00100000:0.0:1782607799.364469:0:14204:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364431872 00000100:00100000:0.0:1782607799.364495:0:14204:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364432000 00000100:00100000:0.0:1782607799.364498:0:14204:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364432000 00000100:00100000:0.0:1782607799.364519:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782607799.364526:0:14204:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458100b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1869199364431872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607799.364574:0:14204:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458100b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1869199364431872:12345-0@lo:400:kworker.0 Request processed in 49us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607799.364581:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782607799.364595:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782607799.364602:0:14204:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458100b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869199364432000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607799.364631:0:14204:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458100b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869199364432000:12345-0@lo:400:kworker.0 Request processed in 31us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607799.364637:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782607799.364659:0:14199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364431488 00000100:00100000:0.0:1782607799.364662:0:14199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364431488 00000100:00100000:0.0:1782607799.364693:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1782607799.364699:0:14199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f5a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+19:3318:x1869199364431488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607799.364732:0:14199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f5a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+19:3318:x1869199364431488:12345-0@lo:400:kworker.0 Request processed in 33us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607799.364738:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:0.0:1782607799.364812:0:14200:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782607799.364819:0:14200:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782607799.364852:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581008a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33f55b46-a882-437e-a0a1-2be6832a7ec1:3318:1869199364431488:0@lo:400:kworker.0 00000100:00100000:0.0:1782607799.364866:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97458100aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1869199364432000:0@lo:400:kworker.0 00000100:00100000:0.0:1782607799.364875:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97458100bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1869199364431872:0@lo:400:kworker.0 00000100:00100000:0.0:1782607799.364913:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869199364431744:0@lo:400:kworker.0 00000100:00100000:0.0:1782607799.364925:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97458100a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364431616:0@lo:400:kworker.0 00000001:00100000:0.0:1782607799.465157:0:7525:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0b859eba-a064-4697-844f-1f4595f38a4c 00000001:02000400:1.0:1782607799.507601:0:16067:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1782607800.322039:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1782607800.481388:0:6634:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0b859eba-a064-4697-844f-1f4595f38a4c 00010000:00010000:1.0:1782607801.348445:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782607801.590786:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607801.590828:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607801.590855:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607801.590877:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607801.590910:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607801.590928:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607801.590949:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607801.590975:0:14838:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342419200 00000100:00100000:2.0:1782607801.590984:0:14838:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342419200 00000100:00100000:2.0:1782607801.591045:0:14838:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342419456 00000100:00100000:2.0:1782607801.591048:0:14838:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342419456 00000100:00100000:2.0:1782607801.591065:0:14838:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342419072 00000100:00100000:2.0:1782607801.591068:0:14838:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342419072 00000100:00100000:2.0:1782607801.591079:0:14838:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342419584 00000100:00100000:2.0:1782607801.591081:0:14838:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342419584 00000100:00100000:2.0:1782607801.591099:0:14838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 6 00000100:00100000:2.0:1782607801.591109:0:14838:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:32e35a33-83b5-4007-97ba-302ed8efa50a+5:2357:x1869199342419200:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607801.591203:0:14838:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:32e35a33-83b5-4007-97ba-302ed8efa50a+5:2357:x1869199342419200:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 95us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607801.591212:0:14838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 6 00000100:00100000:2.0:1782607801.591232:0:14838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7 00000100:00100000:2.0:1782607801.591238:0:14838:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b859eba-a064-4697-844f-1f4595f38a4c+5:2357:x1869199342419456:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607801.591263:0:14838:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b859eba-a064-4697-844f-1f4595f38a4c+5:2357:x1869199342419456:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 25us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607801.591269:0:14838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7 00000100:00100000:2.0:1782607801.591281:0:14838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8 00000100:00100000:2.0:1782607801.591287:0:14838:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:32e35a33-83b5-4007-97ba-302ed8efa50a+5:2356:x1869199342419072:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607801.591307:0:14838:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:32e35a33-83b5-4007-97ba-302ed8efa50a+5:2356:x1869199342419072:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 21us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607801.591313:0:14838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8 00000100:00100000:2.0:1782607801.591330:0:14838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 9 00000100:00100000:2.0:1782607801.591337:0:14838:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b859eba-a064-4697-844f-1f4595f38a4c+5:2356:x1869199342419584:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607801.591359:0:14838:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b859eba-a064-4697-844f-1f4595f38a4c+5:2356:x1869199342419584:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 23us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607801.591365:0:14838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 9 00000100:00100000:2.0:1782607801.591388:0:15978:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342418944 00000100:00100000:2.0:1782607801.591392:0:15978:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342418944 00000100:00100000:2.0:1782607801.591417:0:15978:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342419328 00000100:00100000:2.0:1782607801.591420:0:15978:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342419328 00000100:00100000:2.0:1782607801.591439:0:15978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 20 00000100:00100000:2.0:1782607801.591445:0:15978:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:32e35a33-83b5-4007-97ba-302ed8efa50a+6:2357:x1869199342418944:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607801.591475:0:15978:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:32e35a33-83b5-4007-97ba-302ed8efa50a+6:2357:x1869199342418944:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 29us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607801.591482:0:15978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 20 00000100:00100000:2.0:1782607801.591493:0:15978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 21 00000100:00100000:2.0:1782607801.591499:0:15978:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b859eba-a064-4697-844f-1f4595f38a4c+6:2356:x1869199342419328:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607801.591521:0:15978:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b859eba-a064-4697-844f-1f4595f38a4c+6:2356:x1869199342419328:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 22us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607801.591527:0:15978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 21 00000100:00080000:2.0:1782607801.591545:0:14200:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782607801.591549:0:14200:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782607801.591551:0:14200:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782607801.591826:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342418816 00000100:00100000:3.0:1782607801.591831:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342418816 00000100:00100000:3.0:1782607801.591870:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 104 00000100:00100000:3.0:1782607801.591877:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f5a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e6cd414-a5bd-4223-b33a-76eff85902b7+13:2356:x1869199342418816:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1782607801.591911:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f5a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e6cd414-a5bd-4223-b33a-76eff85902b7+13:2356:x1869199342418816:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 35us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607801.591918:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 104 00010000:00010000:1.0:1782607802.375247:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782607802.435749:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364432128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782607802.435891:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607802.436037:0:14841:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364432128 00000100:00100000:1.0:1782607802.436046:0:14841:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364432128 00000100:00100000:1.0:1782607802.436134:0:14841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782607802.436151:0:14841:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458100a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364432128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782607802.436195:0:14841:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782607802.436261:0:14841:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458100a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364432128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607802.436268:0:14841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782607802.436324:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364432128:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782607802.436393:0:14200:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:0.0:1782607803.004903:0:16216:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffce0cd7910 20000000:00000080:0.0:1782607803.004923:0:16216:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff974577ec5000 uarg=0000000000000000 20000000:01000000:0.0:1782607803.004960:0:16216:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1782607803.004966:0:16216:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1782607803.004972:0:16216:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1782607803.012426:0:16217:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1782607803.012683:0:16216:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1782607803.029497:0:16216:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1782607803.029530:0:16216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9745585ad200/0x8109266df35cc553 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607803.029568:0:16216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97457f466e00/0x8109266df35cc24a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cc243 expref: 18 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607803.029576:0:16216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff974541549a00/0x8109266df35cc297 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cc290 expref: 18 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607803.029583:0:16216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9745585ac400/0x8109266df35cc3cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cc3c4 expref: 18 pid: 14198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607803.029686:0:16216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9745585ac600/0x8109266df35cc4f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a000ae expref: 12 pid: 14198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607803.029693:0:16216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff974571007c00/0x8109266df35cc529 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00110 expref: 12 pid: 14197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607803.029700:0:16216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9745585ad200/0x8109266df35cc553 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607803.029745:0:16216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff974571007c00/0x8109266df35cc529 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00110 expref: 12 pid: 14197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607803.029759:0:16216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff974571007c00/0x8109266df35cc529 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00110 expref: 12 pid: 14197 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607803.029912:0:16216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745508c9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16216:1869199364432256:192.168.202.4@tcp:104: 00010000:00010000:2.0:1782607803.030047:0:16216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9745585ac600/0x8109266df35cc4f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a000ae expref: 12 pid: 14198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607803.030057:0:16216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9745585ac600/0x8109266df35cc4f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a000ae expref: 12 pid: 14198 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607803.030073:0:16216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745508caa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16216:1869199364432384:192.168.202.4@tcp:104: 00010000:00010000:2.0:1782607803.030128:0:16216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9745585ac400/0x8109266df35cc3cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8109266df35cc3c4 expref: 18 pid: 14198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607803.030137:0:16216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9745585ac400/0x8109266df35cc3cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8109266df35cc3c4 expref: 18 pid: 14198 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607803.030147:0:16216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745508c8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16216:1869199364432512:0@lo:104: 00000100:00100000:2.0:1782607803.030198:0:16216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782607803.030253:0:16216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff974541549a00/0x8109266df35cc297 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8109266df35cc290 expref: 18 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607803.030271:0:16216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff974541549a00/0x8109266df35cc297 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8109266df35cc290 expref: 18 pid: 14199 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607803.030279:0:16216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745508cad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16216:1869199364432640:0@lo:104: 00000100:00100000:2.0:1782607803.030300:0:16216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782607803.030331:0:16216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97457f466e00/0x8109266df35cc24a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8109266df35cc243 expref: 18 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607803.030339:0:16216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97457f466e00/0x8109266df35cc24a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8109266df35cc243 expref: 18 pid: 14199 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607803.030347:0:16216:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745508c8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16216:1869199364432768:0@lo:104: 00000100:00100000:2.0:1782607803.030373:0:16216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607803.030384:0:16216:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745498bd300 going to sleep for 11 seconds 00000100:00100000:1.0:1782607803.030865:0:14188:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1782607803.030898:0:14188:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364432512 00000100:00100000:1.0:1782607803.030906:0:14188:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364432512 00000100:00100000:1.0:1782607803.031001:0:14188:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364432640 00000100:00100000:1.0:1782607803.031017:0:14188:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364432640 00000100:00100000:1.0:1782607803.031030:0:14188:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364432768 00000100:00100000:1.0:1782607803.031033:0:14188:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364432768 00000100:00100000:1.0:1782607803.031057:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782607803.031066:0:14188:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33f55b46-a882-437e-a0a1-2be6832a7ec1+5:16216:x1869199364432512:12345-0@lo:104: 00010000:00010000:1.0:1782607803.031097:0:14188:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff97455d649600/0x8109266df35cc3c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cc3cb expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607803.031232:0:14188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782607803.031239:0:14188:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33f55b46-a882-437e-a0a1-2be6832a7ec1+5:16216:x1869199364432512:12345-0@lo:104: Request processed in 175us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607803.031246:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782607803.031274:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782607803.031281:0:14188:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33f55b46-a882-437e-a0a1-2be6832a7ec1+4:16216:x1869199364432640:12345-0@lo:104: 00010000:00010000:1.0:1782607803.031289:0:14188:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff97455d649e00/0x8109266df35cc290 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cc297 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607803.031528:0:14188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1782607803.031533:0:14188:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33f55b46-a882-437e-a0a1-2be6832a7ec1+4:16216:x1869199364432640:12345-0@lo:104: Request processed in 253us (1233us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607803.031564:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782607803.031730:0:16216:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745508c8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16216:1869199364432512:0@lo:104: 00000100:00100000:2.0:1782607803.031742:0:16216:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745508cad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16216:1869199364432640:0@lo:104: 00000100:00100000:1.0:1782607803.031955:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782607803.031964:0:14188:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974544e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33f55b46-a882-437e-a0a1-2be6832a7ec1+3:16216:x1869199364432768:12345-0@lo:104: 00010000:00010000:1.0:1782607803.031974:0:14188:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff974541549200/0x8109266df35cc243 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cc24a expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607803.032018:0:14188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1782607803.032024:0:14188:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974544e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33f55b46-a882-437e-a0a1-2be6832a7ec1+3:16216:x1869199364432768:12345-0@lo:104: Request processed in 62us (1649us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607803.032029:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782607803.032871:0:16216:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745508c8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16216:1869199364432768:0@lo:104: 00010000:00010000:0.0:1782607803.036896:0:14193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782607803.036916:0:14193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff97455d649600/0x8109266df35cc3c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cc3cb expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607803.036932:0:14193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d649600 already unused, calling callback (ffffffffc1db0c20) 10000000:00010000:0.0:1782607803.036937:0:14193:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff97455d649600/0x8109266df35cc3c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8109266df35cc3cb expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607803.036948:0:14193:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff97455d649600/0x8109266df35cc3c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8109266df35cc3cb expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782607803.036968:0:14193:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff97455d649600/0x8109266df35cc3c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8109266df35cc3cb expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782607803.036974:0:14193:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782607803.037044:0:14193:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff97455d649600/0x8109266df35cc3c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cc3cb expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607803.037051:0:14193:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782607803.037076:0:14193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff97455d649600/0x8109266df35cc3c4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cc3cb expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607803.037094:0:14193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff97455d649600/0x8109266df35cc3c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cc3cb expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607803.037134:0:14193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782607803.037138:0:14193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff97455d649e00/0x8109266df35cc290 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cc297 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607803.037144:0:14193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d649e00 already unused, calling callback (ffffffffc1db0c20) 10000000:00010000:0.0:1782607803.037147:0:14193:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff97455d649e00/0x8109266df35cc290 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8109266df35cc297 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607803.037154:0:14193:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff97455d649e00/0x8109266df35cc290 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8109266df35cc297 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782607803.037160:0:14193:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff97455d649e00/0x8109266df35cc290 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8109266df35cc297 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782607803.037165:0:14193:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782607803.037179:0:14193:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff97455d649e00/0x8109266df35cc290 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cc297 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607803.037185:0:14193:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782607803.037213:0:14193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff97455d649e00/0x8109266df35cc290 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cc297 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607803.037220:0:14193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff97455d649e00/0x8109266df35cc290 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cc297 expref: -99 pid: 14836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607803.037229:0:14193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782607803.037233:0:14193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff974541549200/0x8109266df35cc243 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8109266df35cc24a expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607803.037248:0:14193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974541549200 already unused, calling callback (ffffffffc1db0c20) 10000000:00010000:0.0:1782607803.037251:0:14193:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff974541549200/0x8109266df35cc243 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8109266df35cc24a expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607803.037685:0:14193:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff974541549200/0x8109266df35cc243 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8109266df35cc24a expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782607803.037692:0:14193:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff974541549200/0x8109266df35cc243 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8109266df35cc24a expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782607803.037698:0:14193:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782607803.037726:0:14193:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff974541549200/0x8109266df35cc243 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cc24a expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607803.037732:0:14193:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782607803.037740:0:14193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff974541549200/0x8109266df35cc243 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cc24a expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607803.037746:0:14193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff974541549200/0x8109266df35cc243 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8109266df35cc24a expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607803.037789:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607803.037792:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607803.037794:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782607803.037818:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33f55b46-a882-437e-a0a1-2be6832a7ec1:3317:1869199364432896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782607803.037892:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607803.038189:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97458100bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33f55b46-a882-437e-a0a1-2be6832a7ec1:3318:1869199364433024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782607803.038230:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607803.038478:0:14189:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364432896 00000100:00100000:2.0:1782607803.038487:0:14189:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364432896 00010000:00010000:2.0:1782607803.038554:0:14189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9745585ac400/0x8109266df35cc3cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cc3c4 expref: 19 pid: 14198 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607803.038609:0:14189:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364433024 00000100:00100000:2.0:1782607803.038612:0:14189:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364433024 00010000:00010000:2.0:1782607803.038625:0:14189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff974541549a00/0x8109266df35cc297 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cc290 expref: 20 pid: 14199 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607803.038639:0:14189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782607803.038647:0:14189:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581008a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33f55b46-a882-437e-a0a1-2be6832a7ec1+20:3317:x1869199364432896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782607803.038662:0:14189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782607803.038667:0:14189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9745585ac400/0x8109266df35cc3cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cc3c4 expref: 20 pid: 14198 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607803.038677:0:14189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9745585ac400/0x8109266df35cc3cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8109266df35cc3c4 expref: 20 pid: 14198 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607803.038692:0:14189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9745585ac400/0x8109266df35cc3cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8109266df35cc3c4 expref: 20 pid: 14198 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607803.038720:0:14189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782607803.038812:0:14190:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1782607803.038823:0:14190:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1782607803.038902:0:16216:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745508c9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16216:1869199364432256:192.168.202.4@tcp:104: 00000100:00100000:3.0:1782607803.038922:0:16216:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745508caa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16216:1869199364432384:192.168.202.4@tcp:104: 00010000:00010000:3.0:1782607803.038996:0:16216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9745585ad200/0x8109266df35cc553 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607803.039317:0:14191:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1782607803.039337:0:14191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782607803.039345:0:14191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581008e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33f55b46-a882-437e-a0a1-2be6832a7ec1+19:3318:x1869199364433024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782607803.039355:0:14191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782607803.039360:0:14191:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff974541549a00/0x8109266df35cc297 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cc290 expref: 19 pid: 14199 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607803.039369:0:14191:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff974541549a00/0x8109266df35cc297 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8109266df35cc290 expref: 19 pid: 14199 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607803.039380:0:14191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974541549a00/0x8109266df35cc297 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8109266df35cc290 expref: 19 pid: 14199 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607803.039404:0:14191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782607803.040144:0:14189:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581008a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33f55b46-a882-437e-a0a1-2be6832a7ec1+18:3317:x1869199364432896:12345-0@lo:103:ldlm_bl.0 Request processed in 1491us (2246us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607803.040154:0:14189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782607803.040800:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782607803.040813:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97458100aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33f55b46-a882-437e-a0a1-2be6832a7ec1:3318:1869199364433152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782607803.040856:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607803.040910:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33f55b46-a882-437e-a0a1-2be6832a7ec1:3317:1869199364432896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782607803.041001:0:14189:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364433152 00000100:00100000:1.0:1782607803.041007:0:14189:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364433152 00010000:00010000:1.0:1782607803.041032:0:14189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97457f466e00/0x8109266df35cc24a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cc243 expref: 18 pid: 14199 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607803.041055:0:14189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782607803.041061:0:14189:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97454a726450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33f55b46-a882-437e-a0a1-2be6832a7ec1+18:3318:x1869199364433152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782607803.041073:0:14189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782607803.041088:0:14189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97457f466e00/0x8109266df35cc24a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8109266df35cc243 expref: 18 pid: 14199 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607803.041097:0:14189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97457f466e00/0x8109266df35cc24a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8109266df35cc243 expref: 18 pid: 14199 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607803.041120:0:14189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97457f466e00/0x8109266df35cc24a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8109266df35cc243 expref: 18 pid: 14199 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607803.041132:0:14189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782607803.041167:0:14189:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97454a726450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33f55b46-a882-437e-a0a1-2be6832a7ec1+17:3318:x1869199364433152:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607803.041173:0:14189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782607803.041501:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97458100aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33f55b46-a882-437e-a0a1-2be6832a7ec1:3318:1869199364433152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782607803.041789:0:14191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581008e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33f55b46-a882-437e-a0a1-2be6832a7ec1+16:3318:x1869199364433024:12345-0@lo:103:ldlm_bl.0 Request processed in 2443us (3557us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607803.041797:0:14191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1782607803.041852:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782607803.042021:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97458100bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33f55b46-a882-437e-a0a1-2be6832a7ec1:3318:1869199364433024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782607803.049666:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607803.050305:0:16218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342419840 00000100:00100000:1.0:1782607803.050448:0:16218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342419840 00010000:00010000:1.0:1782607803.050494:0:16218:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9745585ac600/0x8109266df35cc4f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a000ae expref: 13 pid: 14198 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607803.050592:0:16218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7 00000100:00100000:1.0:1782607803.050602:0:16218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443368380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8e6cd414-a5bd-4223-b33a-76eff85902b7+13:2355:x1869199342419840:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782607803.050619:0:16218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782607803.050624:0:16218:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9745585ac600/0x8109266df35cc4f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a000ae expref: 13 pid: 14198 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607803.050637:0:16218:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9745585ac600/0x8109266df35cc4f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a000ae expref: 13 pid: 14198 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607803.050656:0:16218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9745585ac600/0x8109266df35cc4f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a000ae expref: 13 pid: 14198 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607803.050672:0:16218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782607803.050730:0:16218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443368380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8e6cd414-a5bd-4223-b33a-76eff85902b7+12:2355:x1869199342419840:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 130us (1487us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607803.050737:0:16218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7 00000100:00100000:2.0:1782607803.054218:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607803.054347:0:14190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342419712 00000100:00100000:1.0:1782607803.054356:0:14190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342419712 00010000:00010000:1.0:1782607803.054394:0:14190:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff974571007c00/0x8109266df35cc529 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00110 expref: 12 pid: 14197 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607803.054455:0:14190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8 00000100:00100000:1.0:1782607803.054465:0:14190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e6cd414-a5bd-4223-b33a-76eff85902b7+12:2356:x1869199342419712:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782607803.054481:0:14190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782607803.054488:0:14190:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff974571007c00/0x8109266df35cc529 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00110 expref: 12 pid: 14197 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607803.054501:0:14190:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff974571007c00/0x8109266df35cc529 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00110 expref: 12 pid: 14197 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607803.054522:0:14190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff974571007c00/0x8109266df35cc529 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00110 expref: 12 pid: 14197 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607803.054541:0:14190:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9745585ad200/0x8109266df35cc553 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607803.054551:0:14190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9745585ad200/0x8109266df35cc553 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607803.054569:0:14190:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9745585ad200/0x8109266df35cc553 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607803.054589:0:14190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9745585ad200/0x8109266df35cc553 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607803.054597:0:14190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9745585ad200/0x8109266df35cc553 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607803.054604:0:14190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9745585ad200/0x8109266df35cc553 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607803.054621:0:14190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ad200 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:1.0:1782607803.054627:0:14190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9745585ad200/0x8109266df35cc553 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607803.054636:0:14190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9745585ad200/0x8109266df35cc553 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607803.054663:0:14190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9745585ad200/0x8109266df35cc553 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607803.054675:0:14190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782607803.054735:0:14190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8e6cd414-a5bd-4223-b33a-76eff85902b7+11:2356:x1869199342419712:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 270us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607803.054744:0:14190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8 00010000:00010000:0.0:1782607803.055243:0:16216:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9745585ad200/0x8109266df35cc553 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607803.055264:0:16216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9745585ad200/0x8109266df35cc553 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607803.055272:0:16216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9745585ad200/0x8109266df35cc553 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607803.394222:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782607804.270465:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607804.270548:0:14198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342419968 00000100:00100000:1.0:1782607804.270558:0:14198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342419968 00000100:00100000:1.0:1782607804.270628:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 105 00000100:00100000:1.0:1782607804.270640:0:14198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f5a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e6cd414-a5bd-4223-b33a-76eff85902b7+11:13718:x1869199342419968:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782607804.270658:0:14198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607804.270681:0:14198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974571007e00/0x8109266df35cc55a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a780b5862a00141 expref: -99 pid: 14198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607804.270714:0:14198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974571007e00/0x8109266df35cc55a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00141 expref: 12 pid: 14198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607804.270727:0:14198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974571007e00/0x8109266df35cc55a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00141 expref: 12 pid: 14198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607804.270751:0:14198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974571007e00, rc 0) 00000100:00100000:1.0:1782607804.270863:0:14198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f5a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e6cd414-a5bd-4223-b33a-76eff85902b7+12:13718:x1869199342419968:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 225us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607804.270872:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 105 00000100:00100000:1.0:1782607804.279738:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607804.280080:0:14199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342420096 00000100:00100000:3.0:1782607804.280103:0:14199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342420096 00000100:00100000:3.0:1782607804.280176:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 106 00000100:00100000:3.0:1782607804.280188:0:14199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f5a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e6cd414-a5bd-4223-b33a-76eff85902b7+12:13718:x1869199342420096:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782607804.280691:0:14199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f5a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e6cd414-a5bd-4223-b33a-76eff85902b7+12:13718:x1869199342420096:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 Request processed in 504us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607804.280701:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 106 00000100:00100000:0.0:1782607804.287721:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607804.287779:0:14198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342420224 00000100:00100000:0.0:1782607804.287790:0:14198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342420224 00000100:00100000:0.0:1782607804.287845:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 107 00000100:00100000:0.0:1782607804.287856:0:14198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f5a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e6cd414-a5bd-4223-b33a-76eff85902b7+12:13718:x1869199342420224:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782607804.288119:0:14198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f5a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e6cd414-a5bd-4223-b33a-76eff85902b7+12:13718:x1869199342420224:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 Request processed in 264us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607804.288128:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 107 00000100:00100000:2.0:1782607804.299436:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607804.300050:0:14199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342420352 00000100:00100000:3.0:1782607804.300062:0:14199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342420352 00000100:00100000:3.0:1782607804.300135:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 108 00000100:00100000:3.0:1782607804.300146:0:14199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f5a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e6cd414-a5bd-4223-b33a-76eff85902b7+12:13718:x1869199342420352:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782607804.300166:0:14199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607804.300186:0:14199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97455d648800/0x8109266df35cc561 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a780b5862a00148 expref: -99 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607804.300217:0:14199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97455d648800/0x8109266df35cc561 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00148 expref: 13 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607804.300231:0:14199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97455d648800/0x8109266df35cc561 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00148 expref: 13 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607804.300267:0:14199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97455d648800, rc 0) 00000100:00100000:3.0:1782607804.300347:0:14199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f5a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e6cd414-a5bd-4223-b33a-76eff85902b7+13:13718:x1869199342420352:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 195us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607804.300356:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 108 00000100:00100000:2.0:1782607804.304310:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607804.304672:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342420480 00000100:00100000:3.0:1782607804.304682:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342420480 00000100:00100000:3.0:1782607804.304736:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 109 00000100:00100000:3.0:1782607804.304745:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f5a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e6cd414-a5bd-4223-b33a-76eff85902b7+13:13718:x1869199342420480:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782607804.306329:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f5a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e6cd414-a5bd-4223-b33a-76eff85902b7+13:13718:x1869199342420480:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 Request processed in 1577us (2020us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607804.306341:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 109 00000100:00100000:2.0:1782607804.310929:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607804.311200:0:14198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342420608 00000100:00100000:3.0:1782607804.311212:0:14198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342420608 00000100:00100000:3.0:1782607804.314175:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 110 00000100:00100000:3.0:1782607804.314197:0:14198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f5a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e6cd414-a5bd-4223-b33a-76eff85902b7+13:13718:x1869199342420608:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782607804.314444:0:14198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f5a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e6cd414-a5bd-4223-b33a-76eff85902b7+13:13718:x1869199342420608:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 Request processed in 256us (3524us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607804.314453:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 110 00010000:00010000:3.0:1782607804.421496:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782607804.484171:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745508c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364433280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782607804.484249:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607804.484327:0:14841:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364433280 00000100:00100000:2.0:1782607804.484335:0:14841:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364433280 00000100:00100000:2.0:1782607804.484388:0:14841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782607804.484398:0:14841:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364433280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782607804.484435:0:14841:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782607804.484484:0:14841:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869199364433280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607804.484491:0:14841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1782607804.484511:0:14200:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782607804.484550:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745508c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1869199364433280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782607804.485577:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364433536:0@lo:400:kworker.0 00000100:00100000:1.0:1782607804.486601:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607804.486680:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1869199364433664:0@lo:400:kworker.0 00000100:00100000:1.0:1782607804.486719:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607804.486754:0:15978:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364433664 00000100:00100000:1.0:1782607804.486761:0:15978:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364433664 00000100:00100000:1.0:1782607804.486823:0:15978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782607804.486831:0:15978:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974577609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1869199364433664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607804.487081:0:14838:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364433536 00000100:00100000:2.0:1782607804.487086:0:14838:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364433536 00000100:00100000:2.0:1782607804.487159:0:14838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782607804.487167:0:14838:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457760aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364433536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782607804.487214:0:14838:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457760aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1869199364433536:12345-0@lo:400:kworker.0 Request processed in 48us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607804.487221:0:14838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1782607804.487244:0:14200:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782607804.487325:0:15978:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974577609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1869199364433664:12345-0@lo:400:kworker.0 Request processed in 494us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607804.487332:0:15978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782607804.487357:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33f55b46-a882-437e-a0a1-2be6832a7ec1:3317:1869199364433408:0@lo:400:kworker.0 00000100:00100000:1.0:1782607804.487389:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607804.487419:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974577608a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3317:1869199364433920:0@lo:400:kworker.0 00000100:00100000:1.0:1782607804.487448:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607804.487470:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782607804.487475:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f40fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1869199364433792:0@lo:400:kworker.0 00000100:00100000:1.0:1782607804.487497:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607804.487524:0:14199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364433408 00000100:00100000:1.0:1782607804.487541:0:14199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364433408 00000100:00100000:1.0:1782607804.487582:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1782607804.487589:0:14199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f5a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+16:3317:x1869199364433408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607804.487699:0:14199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f5a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+16:3317:x1869199364433408:12345-0@lo:400:kworker.0 Request processed in 111us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607804.487706:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1782607804.487735:0:14205:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364433920 00000100:00100000:1.0:1782607804.487739:0:14205:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364433920 00000100:00100000:1.0:1782607804.487786:0:14205:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364433792 00000100:00100000:1.0:1782607804.487790:0:14205:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364433792 00000100:00100000:1.0:1782607804.487812:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782607804.487818:0:14205:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443761180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869199364433920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607804.487870:0:14205:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443761180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869199364433920:12345-0@lo:400:kworker.0 Request processed in 43us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607804.487877:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782607804.487890:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1782607804.487896:0:14205:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443761500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869199364433792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607804.487924:0:14205:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443761500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869199364433792:12345-0@lo:400:kworker.0 Request processed in 29us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607804.487930:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782607804.488074:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1869199364433664:0@lo:400:kworker.0 00000100:00100000:1.0:1782607804.488135:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1869199364433792:0@lo:400:kworker.0 00000100:00100000:1.0:1782607804.488148:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33f55b46-a882-437e-a0a1-2be6832a7ec1:3317:1869199364433408:0@lo:400:kworker.0 00000100:00100000:1.0:1782607804.488157:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974577608a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3317:1869199364433920:0@lo:400:kworker.0 00000100:00080000:1.0:1782607804.488179:0:14200:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782607804.488293:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f40e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1869199364433536:0@lo:400:kworker.0 10000000:01000000:2.0:1782607804.674104:0:14201:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782607804.674114:0:14201:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff974551309000 from 10 10000000:01000000:2.0:1782607804.674120:0:14201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782607804.674167:0:14201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9745585ad000/0x8109266df35cc568 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607804.674199:0:14201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff9745585ad000/0x8109266df35cc568 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607804.674212:0:14201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff9745585ad000/0x8109266df35cc568 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607804.674234:0:14201:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745508c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33f55b46-a882-437e-a0a1-2be6832a7ec1:14201:1869199364434048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782607804.674446:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607804.674510:0:14201:0:(client.c:2701:ptlrpc_set_wait()) set ffff97456dd8f480 going to sleep for 11 seconds 00000100:00100000:3.0:1782607804.674673:0:14198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364434048 00000100:00100000:3.0:1782607804.674680:0:14198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364434048 00000100:00100000:3.0:1782607804.674728:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1782607804.674735:0:14198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+16:14201:x1869199364434048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782607804.674747:0:14198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607804.674796:0:14198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97455d648c00/0x8109266df35cc56f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cc568 expref: -99 pid: 14198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607804.674818:0:14198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97455d648c00/0x8109266df35cc56f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cc568 expref: 17 pid: 14198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607804.674829:0:14198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97455d648c00/0x8109266df35cc56f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cc568 expref: 17 pid: 14198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607804.674839:0:14198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97455d648c00, rc 0) 00000100:00100000:3.0:1782607804.674882:0:14198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+17:14201:x1869199364434048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607804.674887:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1782607804.675060:0:14201:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745508c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33f55b46-a882-437e-a0a1-2be6832a7ec1:14201:1869199364434048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782607804.675071:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff9745585ad000/0x8109266df35cc568 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc56f expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607804.675077:0:14201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff9745585ad000/0x8109266df35cc568 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cc56f expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607804.675141:0:14201:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745508c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33f55b46-a882-437e-a0a1-2be6832a7ec1:14201:1869199364434176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782607804.675169:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607804.675232:0:14201:0:(client.c:2701:ptlrpc_set_wait()) set ffff97456dd8f480 going to sleep for 11 seconds 00000100:00100000:1.0:1782607804.675260:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364434176 00000100:00100000:1.0:1782607804.675263:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364434176 00000100:00100000:1.0:1782607804.675286:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1782607804.675291:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+17:14201:x1869199364434176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782607804.675579:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+17:14201:x1869199364434176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 286us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607804.675586:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1782607804.675706:0:14201:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745508c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33f55b46-a882-437e-a0a1-2be6832a7ec1:14201:1869199364434176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782607804.675728:0:14201:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745508c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33f55b46-a882-437e-a0a1-2be6832a7ec1:14201:1869199364434304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782607804.675760:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607804.675825:0:14201:0:(client.c:2701:ptlrpc_set_wait()) set ffff97456dd8f480 going to sleep for 11 seconds 00000100:00100000:1.0:1782607804.675859:0:14199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364434304 00000100:00100000:1.0:1782607804.675863:0:14199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364434304 00000100:00100000:1.0:1782607804.675912:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1782607804.675916:0:14199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+17:14201:x1869199364434304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782607804.676059:0:14199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+17:14201:x1869199364434304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607804.676066:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1782607804.676135:0:14201:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745508c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33f55b46-a882-437e-a0a1-2be6832a7ec1:14201:1869199364434304:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1782607804.676944:0:16286:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1782607804.677136:0:14201:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1782607804.677154:0:14201:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782607804.677162:0:14201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9745585ad000/0x8109266df35cc568 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc56f expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607804.677172:0:14201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff9745585ad000/0x8109266df35cc568 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc56f expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782607804.677184:0:14201:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782607804.677186:0:14201:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff97454a72d000 from 10 10000000:01000000:3.0:1782607804.677189:0:14201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782607804.677217:0:14201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97455d648000/0x8109266df35cc576 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607804.677223:0:14201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff97455d648000/0x8109266df35cc576 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607804.677230:0:14201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff97455d648000/0x8109266df35cc576 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607804.677249:0:14201:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97444336b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33f55b46-a882-437e-a0a1-2be6832a7ec1:14201:1869199364434432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782607804.677280:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607804.677335:0:14201:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745442769c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782607804.677364:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364434432 00000100:00100000:1.0:1782607804.677368:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364434432 00000100:00100000:1.0:1782607804.677417:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1782607804.677422:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+17:14201:x1869199364434432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782607804.677428:0:14197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607804.677437:0:14197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff974571006c00/0x8109266df35cc57d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cc576 expref: -99 pid: 14197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607804.677451:0:14197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff974571006c00/0x8109266df35cc57d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cc576 expref: 18 pid: 14197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607804.677460:0:14197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff974571006c00/0x8109266df35cc57d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cc576 expref: 18 pid: 14197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607804.677490:0:14197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974571006c00, rc 0) 00000100:00100000:1.0:1782607804.677531:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+18:14201:x1869199364434432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607804.677538:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1782607804.677594:0:14201:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97444336b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33f55b46-a882-437e-a0a1-2be6832a7ec1:14201:1869199364434432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782607804.677603:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff97455d648000/0x8109266df35cc576 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc57d expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607804.677610:0:14201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff97455d648000/0x8109266df35cc576 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cc57d expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607804.677652:0:14201:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745508c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33f55b46-a882-437e-a0a1-2be6832a7ec1:14201:1869199364434560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782607804.677670:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607804.677952:0:14201:0:(client.c:2701:ptlrpc_set_wait()) set ffff97456dd8ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1782607804.678036:0:14198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364434560 00000100:00100000:3.0:1782607804.678041:0:14198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364434560 00000100:00100000:3.0:1782607804.678063:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1782607804.678069:0:14198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+18:14201:x1869199364434560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782607804.678282:0:14198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+18:14201:x1869199364434560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 213us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607804.678287:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1782607804.678344:0:14201:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745508c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33f55b46-a882-437e-a0a1-2be6832a7ec1:14201:1869199364434560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782607804.678365:0:14201:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745508c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33f55b46-a882-437e-a0a1-2be6832a7ec1:14201:1869199364434688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782607804.678389:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607804.678406:0:14201:0:(client.c:2701:ptlrpc_set_wait()) set ffff97456dd8ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1782607804.678438:0:14198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364434688 00000100:00100000:3.0:1782607804.678441:0:14198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364434688 00000100:00100000:3.0:1782607804.678454:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1782607804.678460:0:14198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+18:14201:x1869199364434688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782607804.678623:0:14198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+18:14201:x1869199364434688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 163us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607804.678628:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1782607804.679084:0:14201:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745508c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33f55b46-a882-437e-a0a1-2be6832a7ec1:14201:1869199364434688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782607804.680102:0:16287:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1782607804.680252:0:14201:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1782607804.680266:0:14201:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782607804.680274:0:14201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97455d648000/0x8109266df35cc576 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc57d expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607804.680282:0:14201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff97455d648000/0x8109266df35cc576 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc57d expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782607804.680289:0:14201:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782607804.680298:0:14201:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9745812ef000 from 10 10000000:01000000:3.0:1782607804.680300:0:14201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782607804.680322:0:14201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff97455d649800/0x8109266df35cc584 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607804.680328:0:14201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff97455d649800/0x8109266df35cc584 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607804.680334:0:14201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff97455d649800/0x8109266df35cc584 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607804.680347:0:14201:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974443369c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33f55b46-a882-437e-a0a1-2be6832a7ec1:14201:1869199364434816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782607804.680380:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607804.680430:0:14201:0:(client.c:2701:ptlrpc_set_wait()) set ffff974543959cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782607804.680464:0:14198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364434816 00000100:00100000:2.0:1782607804.680470:0:14198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364434816 00000100:00100000:2.0:1782607804.680535:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1782607804.680543:0:14198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+18:14201:x1869199364434816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782607804.680554:0:14198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607804.680577:0:14198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9745585ada00/0x8109266df35cc58b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8109266df35cc584 expref: -99 pid: 14198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607804.680599:0:14198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9745585ada00/0x8109266df35cc58b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8109266df35cc584 expref: 19 pid: 14198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607804.680606:0:14198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9745585ada00/0x8109266df35cc58b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8109266df35cc584 expref: 19 pid: 14198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607804.680701:0:14198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585ada00, rc 0) 00000100:00100000:2.0:1782607804.680735:0:14198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33f55b46-a882-437e-a0a1-2be6832a7ec1+19:14201:x1869199364434816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 194us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607804.680739:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1782607804.680806:0:14201:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974443369c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33f55b46-a882-437e-a0a1-2be6832a7ec1:14201:1869199364434816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782607804.680820:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff97455d649800/0x8109266df35cc584 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc58b expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607804.680829:0:14201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff97455d649800/0x8109266df35cc584 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8109266df35cc58b expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607804.680879:0:14201:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974443369c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33f55b46-a882-437e-a0a1-2be6832a7ec1:14201:1869199364434944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782607804.680897:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607804.681028:0:14201:0:(client.c:2701:ptlrpc_set_wait()) set ffff974543959cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782607804.681111:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364434944 00000100:00100000:1.0:1782607804.681115:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364434944 00000100:00100000:1.0:1782607804.681131:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1782607804.681135:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+19:14201:x1869199364434944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782607804.681324:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+19:14201:x1869199364434944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 187us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607804.681329:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1782607804.681380:0:14201:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974443369c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33f55b46-a882-437e-a0a1-2be6832a7ec1:14201:1869199364434944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782607804.681400:0:14201:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974443369c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33f55b46-a882-437e-a0a1-2be6832a7ec1:14201:1869199364435072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782607804.681425:0:14201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607804.681440:0:14201:0:(client.c:2701:ptlrpc_set_wait()) set ffff974543959cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782607804.681485:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364435072 00000100:00100000:1.0:1782607804.681489:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364435072 00000100:00100000:1.0:1782607804.681505:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1782607804.681510:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+19:14201:x1869199364435072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782607804.681738:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33f55b46-a882-437e-a0a1-2be6832a7ec1+19:14201:x1869199364435072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 228us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607804.681743:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1782607804.681866:0:14201:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974443369c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33f55b46-a882-437e-a0a1-2be6832a7ec1:14201:1869199364435072:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782607804.682482:0:16288:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1782607804.683023:0:14201:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1782607804.683042:0:14201:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782607804.683050:0:14201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff97455d649800/0x8109266df35cc584 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc58b expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607804.683059:0:14201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff97455d649800/0x8109266df35cc584 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8109266df35cc58b expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607805.442001:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782607806.378329:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607806.378482:0:14205:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342420736 00000100:00100000:1.0:1782607806.378496:0:14205:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342420736 00000100:00100000:1.0:1782607806.378583:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15 00000100:00100000:1.0:1782607806.378598:0:14205:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443369c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+6:14373:x1869199342420736:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782607806.378621:0:14205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607806.378664:0:14205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc592 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b5862a0014f expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1782607806.378668:0:14200:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782607806.378738:0:14205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc599 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.378796:0:14205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc599 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.378810:0:14205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc599 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.378824:0:14205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc5a0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.378831:0:14205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc5a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.378837:0:14205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc5a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.379388:0:14205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974571007200/0x8109266df35cc5a7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.379398:0:14205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974571007200/0x8109266df35cc5a7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.379406:0:14205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974571007200/0x8109266df35cc5a7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782607806.379500:0:14205:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1782607806.379505:0:14205:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1782607806.379589:0:14205:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff974571007200/0x8109266df35cc5a7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.379607:0:14205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc599 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.379613:0:14205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc599 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.379620:0:14205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc599 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.379626:0:14205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974571006400 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607806.379631:0:14205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc599 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.379638:0:14205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc599 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.379650:0:14205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff974543e72500) 00010000:00010000:1.0:1782607806.379653:0:14205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607806.379657:0:14205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc599 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.379664:0:14205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc599 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.379678:0:14205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc5a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.379684:0:14205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc5a0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.379690:0:14205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc5a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.379701:0:14205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974571006e00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607806.379704:0:14205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc5a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.379711:0:14205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc5a0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.379719:0:14205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff97456dd58100) 00010000:00010000:1.0:1782607806.379721:0:14205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607806.379724:0:14205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc5a0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.379730:0:14205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc5a0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.379762:0:14205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc592 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0014f expref: 8 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.379820:0:14205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974571007200/0x8109266df35cc5a7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0014f expref: 7 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.379828:0:14205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff97456dd58900) 00010000:00010000:1.0:1782607806.379830:0:14205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782607806.379833:0:14205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974571007200, rc 0) 00000100:00100000:1.0:1782607806.379904:0:14205:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443369c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+7:14373:x1869199342420736:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 Request processed in 1311us (1592us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607806.379912:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15 00000100:00100000:2.0:1782607806.387871:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607806.388503:0:15978:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342420992 00000100:00100000:1.0:1782607806.388534:0:15978:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342420992 00000100:00100000:1.0:1782607806.388612:0:15978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16 00000100:00100000:1.0:1782607806.388626:0:15978:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:32e35a33-83b5-4007-97ba-302ed8efa50a+7:14373:x1869199342420992:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782607806.388650:0:15978:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607806.388670:0:15978:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc5ae lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b5862a00156 expref: -99 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.388793:0:15978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc5b5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.388811:0:15978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc5b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.388825:0:15978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc5b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.388841:0:15978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974571006200/0x8109266df35cc5bc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.388848:0:15978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974571006200/0x8109266df35cc5bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.388854:0:15978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974571006200/0x8109266df35cc5bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.389411:0:15978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974571006000/0x8109266df35cc5c3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.389422:0:15978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974571006000/0x8109266df35cc5c3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.389429:0:15978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974571006000/0x8109266df35cc5c3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782607806.389446:0:15978:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1782607806.389712:0:15978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc5b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.389720:0:15978:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc5b5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.389726:0:15978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc5b5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.389732:0:15978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974571006400 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607806.389737:0:15978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc5b5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.389744:0:15978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc5b5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.389755:0:15978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff97456dd58900) 00010000:00010000:1.0:1782607806.389759:0:15978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607806.389800:0:15978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc5b5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.389806:0:15978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc5b5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.389820:0:15978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974571006200/0x8109266df35cc5bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.389826:0:15978:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974571006200/0x8109266df35cc5bc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.389840:0:15978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974571006200/0x8109266df35cc5bc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.389846:0:15978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974571006200 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607806.389849:0:15978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974571006200/0x8109266df35cc5bc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.389855:0:15978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974571006200/0x8109266df35cc5bc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.389862:0:15978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff97456dd58100) 00010000:00010000:1.0:1782607806.389865:0:15978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607806.389868:0:15978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974571006200/0x8109266df35cc5bc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.389874:0:15978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974571006200/0x8109266df35cc5bc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.390375:0:15978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc5ae lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00156 expref: 10 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.390393:0:15978:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974571006000/0x8109266df35cc5c3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00156 expref: 9 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.390401:0:15978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97456dd58f00) 00010000:00010000:1.0:1782607806.390403:0:15978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607806.390406:0:15978:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974571006000, rc 0) 00000100:00100000:1.0:1782607806.390493:0:15978:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:32e35a33-83b5-4007-97ba-302ed8efa50a+9:14373:x1869199342420992:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 Request processed in 1869us (2631us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1782607806.390511:0:15978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16 00000100:00100000:2.0:1782607806.415506:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607806.415876:0:14204:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342421120 00000100:00100000:0.0:1782607806.415891:0:14204:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342421120 00000100:00100000:0.0:1782607806.416085:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17 00000100:00100000:0.0:1782607806.416118:0:14204:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32e35a33-83b5-4007-97ba-302ed8efa50a+9:14373:x1869199342421120:12345-192.168.202.4@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1782607806.416274:0:14204:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32e35a33-83b5-4007-97ba-302ed8efa50a+9:14373:x1869199342421120:12345-192.168.202.4@tcp:59:lhsmtool_posix.0 Request processed in 161us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607806.416283:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17 00010000:00010000:3.0:1782607806.468262:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782607806.477507:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607806.477705:0:15978:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342421248 00000100:00100000:1.0:1782607806.477715:0:15978:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342421248 00000100:00100000:1.0:1782607806.477829:0:15978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 18 00000100:00100000:1.0:1782607806.477840:0:15978:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:32e35a33-83b5-4007-97ba-302ed8efa50a+9:14379:x1869199342421248:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1782607806.477864:0:15978:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607806.477887:0:15978:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc5d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b5862a0015d expref: -99 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.477956:0:15978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974571006200/0x8109266df35cc5d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.477984:0:15978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974571006200/0x8109266df35cc5d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.477996:0:15978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974571006200/0x8109266df35cc5d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.478010:0:15978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc5df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.478017:0:15978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc5df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.478024:0:15978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc5df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.478445:0:15978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974571006200/0x8109266df35cc5d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.478465:0:15978:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974571006200/0x8109266df35cc5d8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.478471:0:15978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974571006200/0x8109266df35cc5d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.478476:0:15978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974571006200 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607806.478481:0:15978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974571006200/0x8109266df35cc5d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.478488:0:15978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974571006200/0x8109266df35cc5d8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.478500:0:15978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff974543e72500) 00010000:00010000:1.0:1782607806.478503:0:15978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607806.478508:0:15978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974571006200/0x8109266df35cc5d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.478514:0:15978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974571006200/0x8109266df35cc5d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.478527:0:15978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc5df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.478532:0:15978:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc5df lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.478536:0:15978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc5df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.478541:0:15978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974571006400 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607806.478549:0:15978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc5df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.478556:0:15978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc5df lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.478564:0:15978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff97456dd58100) 00010000:00010000:1.0:1782607806.478567:0:15978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607806.478570:0:15978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc5df lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.478576:0:15978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc5df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.478610:0:15978:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc5d1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0015d expref: 10 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.478619:0:15978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff974543e72500) 00010000:00010000:1.0:1782607806.478621:0:15978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607806.478625:0:15978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc5d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0015d expref: 10 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.478634:0:15978:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974571006e00, rc 0) 00000100:00100000:1.0:1782607806.478716:0:15978:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:32e35a33-83b5-4007-97ba-302ed8efa50a+9:14379:x1869199342421248:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 878us (1220us total) trans 0 rc 301/301 00000100:00100000:1.0:1782607806.478725:0:15978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 18 00000100:00100000:2.0:1782607806.493186:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607806.493337:0:14213:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342421376 00000100:00100000:0.0:1782607806.493350:0:14213:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342421376 00000100:00100000:0.0:1782607806.493421:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 0 00000100:00100000:0.0:1782607806.493431:0:14213:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:32e35a33-83b5-4007-97ba-302ed8efa50a+9:14379:x1869199342421376:12345-192.168.202.4@tcp:700:lfs.0 00000100:00100000:0.0:1782607806.493531:0:14213:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:32e35a33-83b5-4007-97ba-302ed8efa50a+9:14379:x1869199342421376:12345-192.168.202.4@tcp:700:lfs.0 Request processed in 101us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607806.493539:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 0 00000100:00100000:3.0:1782607806.497535:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607806.497717:0:14205:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342421632 00000100:00100000:1.0:1782607806.497728:0:14205:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342421632 00000100:00100000:1.0:1782607806.498165:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 19 00000100:00100000:1.0:1782607806.498178:0:14205:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97444336b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+9:14379:x1869199342421632:12345-192.168.202.4@tcp:36:lfs.0 00010000:00010000:1.0:1782607806.498267:0:14205:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782607806.498296:0:14205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974442876000/0x8109266df35cc514 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a000d8 expref: 9 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.498317:0:14205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff974543e72500) 00010000:00010000:1.0:1782607806.498322:0:14205:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782607806.498602:0:14205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc5e6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.498619:0:14205:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff974571007400/0x8109266df35cc54c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0013a expref: 5 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.498628:0:14205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc5e6 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.498661:0:14205:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff974571007400/0x8109266df35cc54c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0013a expref: 5 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.498676:0:14205:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff974571007400/0x8109266df35cc54c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0013a expref: 5 pid: 15978 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607806.498691:0:14205:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974443763800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14205:1869199364435200:192.168.202.4@tcp:104: 00000100:00100000:1.0:1782607806.499001:0:14205:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745812d7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1782607806.505401:0:14205:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974443763800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14205:1869199364435200:192.168.202.4@tcp:104: 00010000:00010000:1.0:1782607806.505438:0:14205:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc5e6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607806.505676:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607806.505875:0:14189:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342421760 00000100:00100000:2.0:1782607806.505884:0:14189:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342421760 00010000:00010000:2.0:1782607806.505940:0:14189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff974571007400/0x8109266df35cc54c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0013a expref: 6 pid: 15978 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607806.505985:0:14189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 9 00000100:00100000:2.0:1782607806.505994:0:14189:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581538e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b859eba-a064-4697-844f-1f4595f38a4c+6:2357:x1869199342421760:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782607806.506009:0:14189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782607806.506017:0:14189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff974571007400/0x8109266df35cc54c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0013a expref: 6 pid: 15978 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607806.506029:0:14189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff974571007400/0x8109266df35cc54c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0013a expref: 6 pid: 15978 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607806.506054:0:14189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974571007400/0x8109266df35cc54c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0013a expref: 6 pid: 15978 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607806.506071:0:14189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff974543e72500) 00010000:00010000:2.0:1782607806.506100:0:14189:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc5e6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607806.506109:0:14189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc5e6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607806.506116:0:14189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc5e6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607806.506146:0:14189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782607806.506199:0:14189:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581538e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b859eba-a064-4697-844f-1f4595f38a4c+5:2357:x1869199342421760:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 204us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607806.506209:0:14189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 9 00000100:00080000:1.0:1782607806.506348:0:14200:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782607806.506650:0:14205:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc5e6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.506660:0:14205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc5e6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.506687:0:14205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974442877600/0x8109266df35cc5ed lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.506697:0:14205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974442877600/0x8109266df35cc5ed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.506706:0:14205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974442877600/0x8109266df35cc5ed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782607806.511550:0:14205:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1782607806.511574:0:14205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc5e6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.511600:0:14205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc5e6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.511609:0:14205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc5e6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.511615:0:14205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974571006e00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607806.511621:0:14205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc5e6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.511629:0:14205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc5e6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.511650:0:14205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff974543e72500) 00010000:00010000:0.0:1782607806.511654:0:14205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782607806.511661:0:14205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc5e6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.511667:0:14205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc5e6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782607806.511697:0:14205:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007a0f5eea reply state 000000007540456a transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff974442877600/0x8109266df35cc5ed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607806.511707:0:14205:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782607806.515357:0:14205:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97444336b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+10:14379:x1869199342421632:12345-192.168.202.4@tcp:36:lfs.0 Request processed in 17169us (17822us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1782607806.515371:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 19 00010000:00010000:1.0:1782607806.527305:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974442877600/0x8109266df35cc5ed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.527327:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974442877600/0x8109266df35cc5ed lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.527336:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974442877600/0x8109266df35cc5ed lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.527344:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974442877600 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607806.527351:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974442877600/0x8109266df35cc5ed lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.527361:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974442877600/0x8109266df35cc5ed lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.527384:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff974543e72f00) 00010000:00010000:1.0:1782607806.527389:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607806.527394:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974442877600/0x8109266df35cc5ed lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.527401:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974442877600/0x8109266df35cc5ed lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607806.636083:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607806.636200:0:15978:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342421888 00000100:00100000:1.0:1782607806.636213:0:15978:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342421888 00000100:00100000:1.0:1782607806.636286:0:15978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 20 00000100:00100000:1.0:1782607806.636298:0:15978:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:32e35a33-83b5-4007-97ba-302ed8efa50a+9:14387:x1869199342421888:12345-192.168.202.4@tcp:101:lctl.0 00010000:00010000:1.0:1782607806.636322:0:15978:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607806.636347:0:15978:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc5f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b5862a00164 expref: -99 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.636438:0:15978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974571006200/0x8109266df35cc5fb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.636453:0:15978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974571006200/0x8109266df35cc5fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.636466:0:15978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974571006200/0x8109266df35cc5fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782607806.636531:0:15978:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1782607806.636536:0:15978:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1782607806.636577:0:15978:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff974571006200/0x8109266df35cc5fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.636602:0:15978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc5f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00164 expref: 11 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.636621:0:15978:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974571006200/0x8109266df35cc5fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00164 expref: 10 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.636630:0:15978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97456dd58100) 00010000:00010000:1.0:1782607806.636633:0:15978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782607806.636637:0:15978:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974571006200, rc 0) 00000100:00100000:1.0:1782607806.636712:0:15978:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:32e35a33-83b5-4007-97ba-302ed8efa50a+10:14387:x1869199342421888:12345-192.168.202.4@tcp:101:lctl.0 Request processed in 415us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607806.636719:0:15978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 20 00000100:00100000:3.0:1782607806.669924:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607806.670127:0:14204:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342422016 00000100:00100000:0.0:1782607806.670148:0:14204:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342422016 00000100:00100000:0.0:1782607806.670276:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 21 00000100:00100000:0.0:1782607806.670290:0:14204:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458153aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b859eba-a064-4697-844f-1f4595f38a4c+5:14388:x1869199342422016:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1782607806.670314:0:14204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607806.670339:0:14204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974442877c00/0x8109266df35cc602 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b5862a0016b expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.670411:0:14204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974442877800/0x8109266df35cc609 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.670426:0:14204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974442877800/0x8109266df35cc609 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.670437:0:14204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974442877800/0x8109266df35cc609 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782607806.670510:0:14204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782607806.670514:0:14204:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1782607806.670541:0:14204:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff974442877800/0x8109266df35cc609 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.670567:0:14204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974442877c00/0x8109266df35cc602 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0016b expref: 7 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.670589:0:14204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974442877800/0x8109266df35cc609 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0016b expref: 6 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.670598:0:14204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97456dd58100) 00010000:00010000:0.0:1782607806.670602:0:14204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782607806.670606:0:14204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974442877800, rc 0) 00000100:00100000:0.0:1782607806.670690:0:14204:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458153aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b859eba-a064-4697-844f-1f4595f38a4c+6:14388:x1869199342422016:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 403us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607806.670705:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 21 00000100:00100000:3.0:1782607806.673665:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607806.673873:0:15978:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342422144 00000100:00100000:1.0:1782607806.673886:0:15978:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342422144 00000100:00100000:1.0:1782607806.674120:0:15978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 22 00000100:00100000:1.0:1782607806.674143:0:15978:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581538000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b859eba-a064-4697-844f-1f4595f38a4c+6:14388:x1869199342422144:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1782607806.674243:0:15978:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607806.674273:0:15978:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc610 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b5862a00172 expref: -99 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.674374:0:15978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc617 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.674468:0:15978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc617 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.674487:0:15978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc617 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.674506:0:15978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc61e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.674514:0:15978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc61e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.674522:0:15978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc61e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.674690:0:15978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974571007400/0x8109266df35cc625 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.674699:0:15978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974571007400/0x8109266df35cc625 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.674707:0:15978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974571007400/0x8109266df35cc625 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782607806.674810:0:15978:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1782607806.674816:0:15978:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782607806.674857:0:15978:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff974571007400/0x8109266df35cc625 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.674875:0:15978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc617 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.674884:0:15978:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc617 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.674892:0:15978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc617 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.674900:0:15978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974571006600 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607806.674906:0:15978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc617 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.674915:0:15978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc617 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.674931:0:15978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97456dd58100) 00010000:00010000:1.0:1782607806.674935:0:15978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607806.674941:0:15978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc617 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.674947:0:15978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc617 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.674977:0:15978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc61e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.674994:0:15978:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc61e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.675000:0:15978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc61e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.675005:0:15978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974571006e00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607806.675009:0:15978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc61e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.675016:0:15978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc61e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.675023:0:15978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff97456dd58400) 00010000:00010000:1.0:1782607806.675026:0:15978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607806.675029:0:15978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc61e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.675035:0:15978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc61e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.675081:0:15978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc610 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00172 expref: 8 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.675098:0:15978:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974571007400/0x8109266df35cc625 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00172 expref: 7 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.675107:0:15978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97456dd58d00) 00010000:00010000:1.0:1782607806.675109:0:15978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782607806.675118:0:15978:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974571007400, rc 0) 00000100:00100000:1.0:1782607806.676146:0:15978:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581538000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b859eba-a064-4697-844f-1f4595f38a4c+7:14388:x1869199342422144:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 1995us (2570us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607806.676173:0:15978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 22 00000100:00100000:2.0:1782607806.684677:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607806.685339:0:14204:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342422400 00000100:00100000:0.0:1782607806.685354:0:14204:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342422400 00000100:00100000:0.0:1782607806.685540:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 23 00000100:00100000:0.0:1782607806.685563:0:14204:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b859eba-a064-4697-844f-1f4595f38a4c+7:14388:x1869199342422400:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1782607806.685595:0:14204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607806.685625:0:14204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974442877c00/0x8109266df35cc62c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b5862a00179 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782607806.685848:0:14204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1782607806.686110:0:14204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974442877c00/0x8109266df35cc62c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00179 expref: 9 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.686129:0:14204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97456dd58100) 00010000:00010000:0.0:1782607806.686132:0:14204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782607806.686258:0:14204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974442877c00/0x8109266df35cc62c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00179 expref: 9 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.686278:0:14204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974442877c00, rc 0) 00000100:00100000:0.0:1782607806.686432:0:14204:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b859eba-a064-4697-844f-1f4595f38a4c+8:14388:x1869199342422400:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 872us (1770us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1782607806.686442:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 23 00000100:00100000:3.0:1782607806.690588:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607806.691011:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342422656 00000100:00100000:2.0:1782607806.691026:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342422656 00000100:00100000:2.0:1782607806.691295:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 24 00000100:00100000:2.0:1782607806.691308:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581539500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b859eba-a064-4697-844f-1f4595f38a4c+8:14388:x1869199342422656:12345-192.168.202.4@tcp:36:lfs.0 00010000:00010000:2.0:1782607806.691404:0:14206:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782607806.691439:0:14206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974571007400/0x8109266df35cc625 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00172 expref: 8 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607806.691465:0:14206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97456dd58d00) 00010000:00010000:2.0:1782607806.691477:0:14206:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782607806.691510:0:14206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cc63a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607806.691526:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cc63a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607806.691558:0:14206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cc63a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782607806.691884:0:14206:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a1357d65 reply state 000000005ff158c5 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cc63a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607806.691897:0:14206:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1782607806.691913:0:14206:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1782607806.692032:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581539500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b859eba-a064-4697-844f-1f4595f38a4c+9:14388:x1869199342422656:12345-192.168.202.4@tcp:36:lfs.0 Request processed in 725us (1458us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1782607806.692040:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 24 00000100:00100000:3.0:1782607806.696003:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607806.696178:0:14207:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342422912 00000100:00100000:0.0:1782607806.696192:0:14207:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342422912 00000100:00100000:0.0:1782607806.696270:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2 00000100:00100000:0.0:1782607806.696282:0:14207:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458153a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b859eba-a064-4697-844f-1f4595f38a4c+9:14388:x1869199342422912:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:0.0:1782607806.696668:0:14207:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458153a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b859eba-a064-4697-844f-1f4595f38a4c+10:14388:x1869199342422912:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 387us (686us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1782607806.696678:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2 00010000:00010000:1.0:1782607806.697367:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cc63a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.697384:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cc63a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.697405:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cc63a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.697414:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ac600 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607806.697422:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cc63a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.697432:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cc63a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.697456:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9745432c6400) 00010000:00010000:1.0:1782607806.697460:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1782607806.697466:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cc63a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.697474:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac600/0x8109266df35cc63a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607806.706286:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607806.706452:0:14205:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342423168 00000100:00100000:1.0:1782607806.706468:0:14205:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342423168 00000100:00100000:1.0:1782607806.706565:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 25 00000100:00100000:1.0:1782607806.706578:0:14205:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581539180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b859eba-a064-4697-844f-1f4595f38a4c+9:14388:x1869199342423168:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1782607806.706643:0:14205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607806.706673:0:14205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc641 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b5862a00180 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.706852:0:14205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc648 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.706873:0:14205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc648 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.706887:0:14205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc648 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.706905:0:14205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc64f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.706912:0:14205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc64f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.706920:0:14205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc64f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782607806.707308:0:14205:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1782607806.707471:0:14205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc648 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.707481:0:14205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc648 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.707490:0:14205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc648 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.707508:0:14205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974571006e00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607806.707515:0:14205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc648 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.707525:0:14205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc648 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.707541:0:14205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97456dd58100) 00010000:00010000:1.0:1782607806.707545:0:14205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607806.707551:0:14205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc648 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.707558:0:14205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc648 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.707577:0:14205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc64f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.707583:0:14205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc64f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.707590:0:14205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc64f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.707595:0:14205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974571006600 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607806.707598:0:14205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc64f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.707604:0:14205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc64f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.707624:0:14205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff97456dd58400) 00010000:00010000:1.0:1782607806.707932:0:14205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607806.707939:0:14205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc64f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.707946:0:14205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc64f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.708098:0:14205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc641 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00180 expref: 11 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.708111:0:14205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97456dd58100) 00010000:00010000:1.0:1782607806.708113:0:14205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782607806.708117:0:14205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc641 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00180 expref: 11 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.708128:0:14205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974571006400, rc 0) 00000100:00100000:1.0:1782607806.708234:0:14205:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581539180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b859eba-a064-4697-844f-1f4595f38a4c+10:14388:x1869199342423168:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 1656us (1963us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1782607806.708247:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 25 00000100:00100000:3.0:1782607806.709738:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607806.709920:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607806.709952:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607806.710116:0:14197:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342423296 00000100:00100000:1.0:1782607806.710129:0:14197:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342423296 00000100:00100000:1.0:1782607806.710198:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 121 00000100:00100000:1.0:1782607806.710211:0:14197:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e6cd414-a5bd-4223-b33a-76eff85902b7+13:2357:x1869199342423296:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1782607806.710297:0:14197:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e6cd414-a5bd-4223-b33a-76eff85902b7+13:2357:x1869199342423296:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 88us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607806.710304:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 121 00000100:00100000:3.0:1782607806.710451:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607806.730599:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607806.732047:0:14839:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342423424 00000100:00100000:0.0:1782607806.732057:0:14839:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342423424 00000100:00100000:0.0:1782607806.732553:0:14839:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342423552 00000100:00100000:0.0:1782607806.732559:0:14839:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342423552 00000100:00100000:0.0:1782607806.732580:0:14839:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342423680 00000100:00100000:0.0:1782607806.732582:0:14839:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342423680 00000100:00100000:0.0:1782607806.732600:0:14839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11 00000100:00100000:0.0:1782607806.732607:0:14839:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458153bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+5:2356:x1869199342423424:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1782607806.732682:0:14839:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458153bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+5:2356:x1869199342423424:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 76us (22763us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607806.732687:0:14839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11 00000100:00100000:0.0:1782607806.732702:0:14839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 12 00000100:00100000:0.0:1782607806.732706:0:14839:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458153b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+5:2357:x1869199342423552:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1782607806.732721:0:14839:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458153b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+5:2357:x1869199342423552:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 15us (22770us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607806.732724:0:14839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 12 00000100:00100000:0.0:1782607806.732733:0:14839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 13 00000100:00100000:0.0:1782607806.732737:0:14839:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581538a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b859eba-a064-4697-844f-1f4595f38a4c+5:2356:x1869199342423680:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1782607806.732755:0:14839:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581538a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b859eba-a064-4697-844f-1f4595f38a4c+5:2356:x1869199342423680:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 17us (22306us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607806.732761:0:14839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 13 00000100:00080000:0.0:1782607806.732823:0:14200:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782607806.732844:0:14200:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782607806.735163:0:14838:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342423808 00000100:00100000:1.0:1782607806.735180:0:14838:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342423808 00000100:00100000:3.0:1782607806.735215:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607806.735260:0:15978:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342423936 00000100:00100000:3.0:1782607806.735269:0:15978:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342423936 00000100:00100000:2.0:1782607806.735283:0:14840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 14 00000100:00100000:3.0:1782607806.735318:0:15978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 26 00000100:00100000:3.0:1782607806.735327:0:15978:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581539f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b859eba-a064-4697-844f-1f4595f38a4c+10:14388:x1869199342423936:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1782607806.735374:0:15978:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607806.735404:0:15978:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cc65d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b5862a00187 expref: -99 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607806.735476:0:14840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458153a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b859eba-a064-4697-844f-1f4595f38a4c+5:2357:x1869199342423808:12345-192.168.202.4@tcp:400:kworker.0 00010000:00010000:3.0:1782607806.735493:0:15978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cc664 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607806.735508:0:15978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cc664 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607806.735521:0:15978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cc664 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782607806.735573:0:15978:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1782607806.735577:0:15978:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782607806.735604:0:15978:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cc664 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607806.735633:0:15978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cc65d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00187 expref: 12 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607806.735649:0:15978:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cc664 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00187 expref: 11 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607806.735657:0:15978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9745454f5200) 00010000:00010000:3.0:1782607806.735659:0:15978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782607806.735662:0:15978:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97455d649a00, rc 0) 00000100:00100000:3.0:1782607806.735713:0:15978:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581539f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b859eba-a064-4697-844f-1f4595f38a4c+11:14388:x1869199342423936:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 388us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607806.735719:0:15978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 26 00000100:00100000:2.0:1782607806.736454:0:14840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458153a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b859eba-a064-4697-844f-1f4595f38a4c+5:2357:x1869199342423808:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 990us (5865us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607806.736464:0:14840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 14 00000100:00080000:0.0:1782607806.737478:0:14200:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782607806.743590:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607806.743727:0:14207:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342424064 00000100:00100000:0.0:1782607806.743737:0:14207:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342424064 00000100:00100000:0.0:1782607806.743834:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 3 00000100:00100000:0.0:1782607806.743846:0:14207:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581539880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b859eba-a064-4697-844f-1f4595f38a4c+11:14388:x1869199342424064:12345-192.168.202.4@tcp:37:lfs.0 00000100:00100000:0.0:1782607806.751033:0:14207:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581539880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b859eba-a064-4697-844f-1f4595f38a4c+11:14388:x1869199342424064:12345-192.168.202.4@tcp:37:lfs.0 Request processed in 7179us (7442us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607806.751046:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 3 00000100:00100000:2.0:1782607806.769639:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607806.769877:0:14208:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342424320 00000100:00100000:3.0:1782607806.769887:0:14208:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342424320 00000100:00100000:3.0:1782607806.769949:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4 00000100:00100000:3.0:1782607806.769971:0:14208:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455113f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b859eba-a064-4697-844f-1f4595f38a4c+11:14388:x1869199342424320:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:3.0:1782607806.770278:0:14208:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455113f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0b859eba-a064-4697-844f-1f4595f38a4c+12:14388:x1869199342424320:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 308us (647us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1782607806.770286:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4 00000040:00080000:3.0:1782607806.786728:0:14236:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1782607806.822957:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607806.823167:0:14204:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342424448 00000100:00100000:0.0:1782607806.823183:0:14204:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342424448 00000100:00100000:0.0:1782607806.823510:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 27 00000100:00100000:0.0:1782607806.823527:0:14204:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458153a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32e35a33-83b5-4007-97ba-302ed8efa50a+10:14394:x1869199342424448:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:0.0:1782607806.823557:0:14204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607806.823584:0:14204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974442876c00/0x8109266df35cc66b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b5862a0018e expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.823664:0:14204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974442876400/0x8109266df35cc672 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.823681:0:14204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974442876400/0x8109266df35cc672 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.823693:0:14204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974442876400/0x8109266df35cc672 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.823711:0:14204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974442877000/0x8109266df35cc679 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.823719:0:14204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974442877000/0x8109266df35cc679 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.823945:0:14204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974442877000/0x8109266df35cc679 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.825501:0:14204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974442876600/0x8109266df35cc680 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.825523:0:14204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974442876600/0x8109266df35cc680 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.825534:0:14204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974442876600/0x8109266df35cc680 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782607806.825581:0:14204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1782607806.825586:0:14204:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782607806.825637:0:14204:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff974442876600/0x8109266df35cc680 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.825653:0:14204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974442876400/0x8109266df35cc672 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.825660:0:14204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974442876400/0x8109266df35cc672 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.825667:0:14204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974442876400/0x8109266df35cc672 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.825674:0:14204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974442876400 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607806.825678:0:14204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974442876400/0x8109266df35cc672 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.825686:0:14204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974442876400/0x8109266df35cc672 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.825715:0:14204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97456dd58100) 00010000:00010000:0.0:1782607806.825718:0:14204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782607806.825723:0:14204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974442876400/0x8109266df35cc672 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.825730:0:14204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974442876400/0x8109266df35cc672 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.825748:0:14204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974442877000/0x8109266df35cc679 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.825754:0:14204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974442877000/0x8109266df35cc679 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.825760:0:14204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974442877000/0x8109266df35cc679 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.825815:0:14204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974442877000 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607806.825819:0:14204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974442877000/0x8109266df35cc679 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.825825:0:14204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974442877000/0x8109266df35cc679 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.825833:0:14204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff974543e72500) 00010000:00010000:0.0:1782607806.825835:0:14204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782607806.825838:0:14204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974442877000/0x8109266df35cc679 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.825844:0:14204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974442877000/0x8109266df35cc679 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.825919:0:14204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974442876c00/0x8109266df35cc66b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0018e expref: 12 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.825942:0:14204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974442876600/0x8109266df35cc680 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0018e expref: 11 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.825950:0:14204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9745454f5200) 00010000:00010000:0.0:1782607806.825952:0:14204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782607806.825954:0:14204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974442876600, rc 0) 00000100:00100000:0.0:1782607806.827922:0:14204:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458153a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32e35a33-83b5-4007-97ba-302ed8efa50a+11:14394:x1869199342424448:12345-192.168.202.4@tcp:101:bash.0 Request processed in 4389us (4973us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607806.827934:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 27 00000100:00100000:2.0:1782607806.832658:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607806.833882:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342424704 00000100:00100000:3.0:1782607806.833901:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342424704 00000100:00100000:3.0:1782607806.834114:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 28 00000100:00100000:3.0:1782607806.834129:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32e35a33-83b5-4007-97ba-302ed8efa50a+11:14394:x1869199342424704:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:3.0:1782607806.834171:0:14206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607806.834202:0:14206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cc687 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b5862a00195 expref: -99 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607806.834415:0:14206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cc68e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607806.834435:0:14206:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cc664 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00187 expref: 11 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607806.834445:0:14206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cc68e lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607806.834503:0:14206:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cc664 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00187 expref: 11 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607806.834541:0:14206:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cc664 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00187 expref: 11 pid: 15978 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607806.834749:0:14206:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581539880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14206:1869199364435328:192.168.202.4@tcp:104: 00000100:00100000:3.0:1782607806.836975:0:14206:0:(client.c:2701:ptlrpc_set_wait()) set ffff974543959480 going to sleep for 11 seconds 00000100:00100000:2.0:1782607806.847428:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607806.848152:0:14190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342424832 00000100:00100000:1.0:1782607806.848177:0:14190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342424832 00010000:00010000:1.0:1782607806.848242:0:14190:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cc664 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00187 expref: 12 pid: 15978 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607806.848367:0:14190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 10 00000100:00100000:1.0:1782607806.848381:0:14190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b859eba-a064-4697-844f-1f4595f38a4c+12:2356:x1869199342424832:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782607806.848420:0:14190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782607806.848429:0:14190:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cc664 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00187 expref: 12 pid: 15978 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.848445:0:14190:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cc664 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00187 expref: 12 pid: 15978 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.848475:0:14190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9745454f5200) 00010000:00010000:1.0:1782607806.848481:0:14190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cc68e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.848493:0:14190:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cc68e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.848503:0:14190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cc68e lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.848529:0:14190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782607806.848615:0:14190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0b859eba-a064-4697-844f-1f4595f38a4c+12:2356:x1869199342424832:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 236us (1202us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607806.848622:0:14190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 10 00010000:00010000:3.0:1782607806.850573:0:14206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cc664 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00187 expref: 11 pid: 15978 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607806.850615:0:14206:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581539880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14206:1869199364435328:192.168.202.4@tcp:104: 00010000:00010000:3.0:1782607806.850658:0:14206:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cc68e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607806.850671:0:14206:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cc68e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607806.850678:0:14206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cc68e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607806.850720:0:14206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cc695 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607806.850736:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cc695 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607806.850746:0:14206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cc695 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607806.854153:0:14206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad600/0x8109266df35cc69c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607806.854492:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad600/0x8109266df35cc69c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607806.854508:0:14206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad600/0x8109266df35cc69c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782607806.855122:0:14206:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1782607806.855251:0:14206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cc68e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607806.855262:0:14206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cc68e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607806.855270:0:14206:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cc68e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607806.855277:0:14206:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d649400 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607806.855283:0:14206:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cc68e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607806.855291:0:14206:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cc68e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607806.855311:0:14206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9745454f5200) 00010000:00010000:2.0:1782607806.855315:0:14206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607806.855321:0:14206:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cc68e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607806.855329:0:14206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649400/0x8109266df35cc68e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782607806.855351:0:14206:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003e2c246d reply state 0000000090e77900 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cc695 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607806.855362:0:14206:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782607806.855495:0:14206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649200/0x8109266df35cc687 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00195 expref: 14 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607806.855529:0:14206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad600/0x8109266df35cc69c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00195 expref: 13 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607806.855538:0:14206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9745432c6c00) 00010000:00010000:2.0:1782607806.855540:0:14206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1782607806.855543:0:14206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585ad600, rc 0) 00000100:00100000:2.0:1782607806.856709:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32e35a33-83b5-4007-97ba-302ed8efa50a+14:14394:x1869199342424704:12345-192.168.202.4@tcp:101:bash.0 Request processed in 22573us (24056us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1782607806.856724:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 28 00010000:00010000:1.0:1782607806.864592:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cc695 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.864618:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cc695 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.864626:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cc695 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.864633:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d649e00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607806.864638:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cc695 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.864647:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cc695 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.864669:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9745454f5b00) 00010000:00010000:1.0:1782607806.864673:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782607806.864679:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cc695 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.864686:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cc695 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607806.872585:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607806.873122:0:14205:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342424960 00000100:00100000:1.0:1782607806.873141:0:14205:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342424960 00000100:00100000:1.0:1782607806.873237:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 29 00000100:00100000:1.0:1782607806.873249:0:14205:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+13:14394:x1869199342424960:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:1.0:1782607806.873283:0:14205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607806.873309:0:14205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc6aa lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b5862a0019c expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.873675:0:14205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc6b1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.873694:0:14205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc6b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.873707:0:14205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc6b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782607806.873761:0:14205:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1782607806.873867:0:14205:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782607806.873901:0:14205:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc6b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.873914:0:14205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc6b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.873945:0:14205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc6aa lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0019c expref: 15 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.874042:0:14205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc6b1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0019c expref: 14 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.874053:0:14205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9745432c6c00) 00010000:00010000:1.0:1782607806.874057:0:14205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782607806.874061:0:14205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974571006600, rc 0) 00000100:00100000:1.0:1782607806.874220:0:14205:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+14:14394:x1869199342424960:12345-192.168.202.4@tcp:101:bash.0 Request processed in 972us (1652us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607806.874230:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 29 00000100:00100000:3.0:1782607806.878879:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607806.879006:0:14208:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342425216 00000100:00100000:0.0:1782607806.879021:0:14208:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342425216 00000100:00100000:0.0:1782607806.879098:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5 00000100:00100000:0.0:1782607806.879111:0:14208:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581539880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+14:14394:x1869199342425216:12345-192.168.202.4@tcp:35:bash.0 00000100:00100000:0.0:1782607806.880194:0:14208:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581539880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+15:14394:x1869199342425216:12345-192.168.202.4@tcp:35:bash.0 Request processed in 1075us (1320us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1782607806.880209:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5 00000100:00100000:3.0:1782607806.948624:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607806.948967:0:15978:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342425472 00000100:00100000:1.0:1782607806.948980:0:15978:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342425472 00000100:00100000:1.0:1782607806.949059:0:15978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 30 00000100:00100000:1.0:1782607806.949079:0:15978:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458153b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:32e35a33-83b5-4007-97ba-302ed8efa50a+15:14404:x1869199342425472:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1782607806.949115:0:15978:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607806.949141:0:15978:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc6b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b5862a001a3 expref: -99 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782607806.949315:0:15978:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1782607806.949714:0:15978:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc6b8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001a3 expref: 17 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.949734:0:15978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97456dd58100) 00010000:00010000:1.0:1782607806.949738:0:15978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782607806.949745:0:15978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc6b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001a3 expref: 17 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607806.949849:0:15978:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974571006400, rc 0) 00000100:00100000:1.0:1782607806.949935:0:15978:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458153b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:32e35a33-83b5-4007-97ba-302ed8efa50a+16:14404:x1869199342425472:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 865us (1329us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1782607806.949944:0:15978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 30 00000100:00100000:2.0:1782607806.952618:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607806.953002:0:14207:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342425728 00000100:00100000:1.0:1782607806.953016:0:14207:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342425728 00000100:00100000:1.0:1782607806.953113:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 6 00000100:00100000:1.0:1782607806.953127:0:14207:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:32e35a33-83b5-4007-97ba-302ed8efa50a+16:14404:x1869199342425728:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:1.0:1782607806.953957:0:14207:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:32e35a33-83b5-4007-97ba-302ed8efa50a+17:14404:x1869199342425728:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 828us (1349us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1782607806.953989:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 6 00000100:00100000:2.0:1782607806.986257:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607806.986458:0:14204:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342425984 00000100:00100000:0.0:1782607806.986477:0:14204:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342425984 00000100:00100000:0.0:1782607806.986817:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 31 00000100:00100000:0.0:1782607806.986833:0:14204:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32e35a33-83b5-4007-97ba-302ed8efa50a+17:14407:x1869199342425984:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1782607806.986869:0:14204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607806.986901:0:14204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974442876c00/0x8109266df35cc6c6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b5862a001aa expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.987104:0:14204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974442877000/0x8109266df35cc6cd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.987122:0:14204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974442877000/0x8109266df35cc6cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.987139:0:14204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974442877000/0x8109266df35cc6cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782607806.987154:0:14204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1782607806.987644:0:14204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974442876c00/0x8109266df35cc6c6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001aa expref: 20 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.987670:0:14204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974442877000/0x8109266df35cc6cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001aa expref: 19 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607806.987680:0:14204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9745432c6c00) 00010000:00010000:0.0:1782607806.987684:0:14204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782607806.987687:0:14204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974442877000, rc 0) 00000100:00100000:0.0:1782607806.987913:0:14204:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32e35a33-83b5-4007-97ba-302ed8efa50a+19:14407:x1869199342425984:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 1083us (1671us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1782607806.987922:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 31 00000100:00100000:2.0:1782607807.004610:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607807.004678:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607807.005739:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342426112 00000100:00100000:3.0:1782607807.005757:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342426112 00000100:00100000:3.0:1782607807.005890:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 32 00000100:00100000:3.0:1782607807.005907:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f40e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32e35a33-83b5-4007-97ba-302ed8efa50a+19:14407:x1869199342426112:12345-192.168.202.4@tcp:54:lfs.0 00010000:00010000:3.0:1782607807.006031:0:14206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cc6db lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607807.006056:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cc6db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607807.006083:0:14206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cc6db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607807.006122:0:14206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cc6db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607807.006130:0:14206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cc6db lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607807.006138:0:14206:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cc6db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607807.006145:0:14206:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d649600 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:3.0:1782607807.006150:0:14206:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cc6db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607807.006168:0:14206:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cc6db lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607807.006184:0:14206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9745432c6c00) 00010000:00010000:3.0:1782607807.006189:0:14206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782607807.006214:0:14206:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cc6db lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607807.006222:0:14206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cc6db lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607807.006356:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f40e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32e35a33-83b5-4007-97ba-302ed8efa50a+19:14407:x1869199342426112:12345-192.168.202.4@tcp:54:lfs.0 Request processed in 453us (1762us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607807.006372:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 32 00000100:00100000:1.0:1782607807.008010:0:14189:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342426240 00000100:00100000:1.0:1782607807.008028:0:14189:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342426240 00000100:00100000:1.0:1782607807.008118:0:14189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 0 00000100:00100000:1.0:1782607807.008131:0:14189:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f40c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32e35a33-83b5-4007-97ba-302ed8efa50a+19:2357:x1869199342426240:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782607807.008153:0:14189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782607807.008690:0:14189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974442877000/0x8109266df35cc6cd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001aa expref: 19 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607807.008716:0:14189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9745432c6c00) 00010000:00010000:1.0:1782607807.008723:0:14189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782607807.008839:0:14189:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f40c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32e35a33-83b5-4007-97ba-302ed8efa50a+18:2357:x1869199342426240:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 710us (4159us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607807.008848:0:14189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 0 00000100:00100000:3.0:1782607807.008998:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607807.012621:0:14208:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342426496 00000100:00100000:1.0:1782607807.012641:0:14208:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342426496 00000100:00100000:1.0:1782607807.012739:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7 00000100:00100000:1.0:1782607807.012750:0:14208:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458153b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+18:14407:x1869199342426496:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:1.0:1782607807.013564:0:14208:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458153b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+19:14407:x1869199342426496:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 808us (4560us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1782607807.013576:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7 00000100:00100000:3.0:1782607807.295944:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607807.296414:0:14204:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342426752 00000100:00100000:0.0:1782607807.296431:0:14204:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342426752 00000100:00100000:0.0:1782607807.296525:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 33 00000100:00100000:0.0:1782607807.296662:0:14204:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581538380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32e35a33-83b5-4007-97ba-302ed8efa50a+19:14439:x1869199342426752:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1782607807.296699:0:14204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607807.296747:0:14204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974442876c00/0x8109266df35cc6e2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b5862a001b1 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.296919:0:14204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974442876400/0x8109266df35cc6e9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.296939:0:14204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974442876400/0x8109266df35cc6e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.297103:0:14204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974442876400/0x8109266df35cc6e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782607807.297120:0:14204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1782607807.297497:0:14204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974442876c00/0x8109266df35cc6e2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001b1 expref: 22 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.297521:0:14204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974442876400/0x8109266df35cc6e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001b1 expref: 21 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.297532:0:14204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9745432c6c00) 00010000:00010000:0.0:1782607807.297536:0:14204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782607807.297540:0:14204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974442876400, rc 0) 00000100:00100000:0.0:1782607807.298047:0:14204:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581538380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32e35a33-83b5-4007-97ba-302ed8efa50a+21:14439:x1869199342426752:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1509us (2118us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1782607807.298056:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 33 00000100:00100000:2.0:1782607807.304321:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607807.304387:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607807.304528:0:14191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342426880 00000100:00100000:0.0:1782607807.304550:0:14191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342426880 00000100:00100000:0.0:1782607807.304651:0:14191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1 00000100:00100000:0.0:1782607807.304665:0:14191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f40fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32e35a33-83b5-4007-97ba-302ed8efa50a+21:2354:x1869199342426880:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782607807.304709:0:14191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782607807.304744:0:14191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974442876400/0x8109266df35cc6e9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001b1 expref: 21 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.304790:0:14191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9745432c6c00) 00010000:00010000:0.0:1782607807.304796:0:14191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782607807.304873:0:14191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f40fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32e35a33-83b5-4007-97ba-302ed8efa50a+20:2354:x1869199342426880:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 210us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607807.304882:0:14191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1 00000100:00100000:1.0:1782607807.305082:0:14207:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342427136 00000100:00100000:1.0:1782607807.305087:0:14207:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342427136 00000100:00100000:1.0:1782607807.305139:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8 00000100:00100000:1.0:1782607807.305148:0:14207:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f40d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:32e35a33-83b5-4007-97ba-302ed8efa50a+20:14439:x1869199342427136:12345-192.168.202.4@tcp:35:cat.0 00000100:00100000:1.0:1782607807.305599:0:14207:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f40d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:32e35a33-83b5-4007-97ba-302ed8efa50a+21:14439:x1869199342427136:12345-192.168.202.4@tcp:35:cat.0 Request processed in 451us (1209us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1782607807.305607:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8 00000100:00100000:1.0:1782607807.378210:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607807.378400:0:15978:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342427392 00000100:00100000:0.0:1782607807.378415:0:15978:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342427392 00000100:00100000:0.0:1782607807.378500:0:15978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 34 00000100:00100000:0.0:1782607807.378513:0:15978:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443763800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:32e35a33-83b5-4007-97ba-302ed8efa50a+21:14445:x1869199342427392:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:0.0:1782607807.378549:0:15978:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607807.378579:0:15978:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974442876400/0x8109266df35cc6f7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b5862a001b8 expref: -99 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.378740:0:15978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff974442876c00/0x8109266df35cc6fe lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.378759:0:15978:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad600/0x8109266df35cc69c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00195 expref: 22 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.378795:0:15978:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc6b1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0019c expref: 22 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.378804:0:15978:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff974442876c00/0x8109266df35cc6fe lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.378871:0:15978:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc6b1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0019c expref: 22 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.378888:0:15978:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc6b1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0019c expref: 22 pid: 14205 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607807.378912:0:15978:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97458100aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15978:1869199364435456:192.168.202.4@tcp:104: 00010000:00010000:0.0:1782607807.379132:0:15978:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad600/0x8109266df35cc69c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00195 expref: 22 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.379142:0:15978:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad600/0x8109266df35cc69c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00195 expref: 22 pid: 14206 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607807.379152:0:15978:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581009f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15978:1869199364435584:192.168.202.4@tcp:104: 00000100:00100000:0.0:1782607807.379251:0:15978:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745516703c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782607807.383934:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607807.384049:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607807.384343:0:15978:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97458100aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15978:1869199364435456:192.168.202.4@tcp:104: 00000100:00100000:0.0:1782607807.384361:0:15978:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581009f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15978:1869199364435584:192.168.202.4@tcp:104: 00010000:00010000:0.0:1782607807.384403:0:15978:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff974442876c00/0x8109266df35cc6fe lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607807.387740:0:14189:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342427520 00000100:00100000:2.0:1782607807.387762:0:14189:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342427520 00010000:00010000:2.0:1782607807.387845:0:14189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc6b1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0019c expref: 23 pid: 14205 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607807.387904:0:14189:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342427648 00000100:00100000:2.0:1782607807.387908:0:14189:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342427648 00010000:00010000:2.0:1782607807.387925:0:14189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad600/0x8109266df35cc69c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00195 expref: 24 pid: 14206 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607807.388102:0:14189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11 00000100:00100000:2.0:1782607807.389687:0:14189:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97454a727450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32e35a33-83b5-4007-97ba-302ed8efa50a+24:2356:x1869199342427520:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782607807.389717:0:14189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782607807.389732:0:14189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc6b1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0019c expref: 24 pid: 14205 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607807.389753:0:14189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc6b1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0019c expref: 24 pid: 14205 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607807.389798:0:14189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc6b1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a0019c expref: 24 pid: 14205 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607807.389822:0:14189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9745432c6c00) 00010000:00010000:2.0:1782607807.389828:0:14189:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff974442876c00/0x8109266df35cc6fe lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607807.389840:0:14189:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff974442876c00/0x8109266df35cc6fe lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607807.389848:0:14189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782607807.389942:0:14189:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97454a727450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32e35a33-83b5-4007-97ba-302ed8efa50a+23:2356:x1869199342427520:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 282us (6024us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607807.392214:0:14191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 12 00000100:00100000:0.0:1782607807.392255:0:14191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458153ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32e35a33-83b5-4007-97ba-302ed8efa50a+23:2357:x1869199342427648:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782607807.392283:0:14191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782607807.392297:0:14191:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad600/0x8109266df35cc69c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00195 expref: 23 pid: 14206 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.392338:0:14191:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad600/0x8109266df35cc69c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00195 expref: 23 pid: 14206 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.392369:0:14191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad600/0x8109266df35cc69c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a00195 expref: 23 pid: 14206 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.392392:0:14191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9745432c6c00) 00010000:00010000:0.0:1782607807.392399:0:14191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff974442876c00/0x8109266df35cc6fe lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.392409:0:14191:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff974442876c00/0x8109266df35cc6fe lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.392417:0:14191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974442876c00/0x8109266df35cc6fe lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.392462:0:14191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782607807.392536:0:14191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458153ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32e35a33-83b5-4007-97ba-302ed8efa50a+22:2357:x1869199342427648:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 306us (8487us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607807.392545:0:14191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 12 00010000:00010000:0.0:1782607807.392606:0:15978:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff974442876c00/0x8109266df35cc6fe lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.392615:0:15978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974442876c00/0x8109266df35cc6fe lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782607807.392640:0:15978:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000100:00100000:2.0:1782607807.392726:0:14189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11 00010000:00010000:0.0:1782607807.392922:0:15978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974442876400/0x8109266df35cc6f7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001b8 expref: 22 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.392951:0:15978:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974442876c00/0x8109266df35cc6fe lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001b8 expref: 21 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.392959:0:15978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9745432c6c00) 00010000:00010000:0.0:1782607807.392962:0:15978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782607807.392965:0:15978:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974442876c00, rc 0) 00000100:00100000:0.0:1782607807.392993:0:15978:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443763800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:32e35a33-83b5-4007-97ba-302ed8efa50a+21:14445:x1869199342427392:12345-192.168.202.4@tcp:101:dd.0 Request processed in 14484us (14801us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1782607807.393001:0:15978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 34 00000100:00100000:2.0:1782607807.405386:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607807.406133:0:14205:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342427904 00000100:00100000:1.0:1782607807.406149:0:14205:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342427904 00000100:00100000:1.0:1782607807.406250:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 35 00000100:00100000:1.0:1782607807.406263:0:14205:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f40c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+21:14445:x1869199342427904:12345-192.168.202.4@tcp:36:dd.0 00010000:00010000:1.0:1782607807.406662:0:14205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc70c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607807.406686:0:14205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc70c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607807.406700:0:14205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc70c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782607807.406802:0:14205:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1782607807.406926:0:14205:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000394352d7 reply state 000000005240f3ed transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc70c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607807.406939:0:14205:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782607807.407081:0:14205:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f40c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+24:14445:x1869199342427904:12345-192.168.202.4@tcp:36:dd.0 Request processed in 819us (1712us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1782607807.407090:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 35 00000020:00080000:0.0:1782607807.407096:0:14205:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782607807.411857:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc70c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607807.411880:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc70c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607807.411890:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc70c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607807.411897:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974571006e00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:3.0:1782607807.411905:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc70c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607807.411914:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc70c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607807.411937:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9745432c6c00) 00010000:00010000:3.0:1782607807.411941:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782607807.412473:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607807.412689:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342428032 00000100:00100000:1.0:1782607807.412703:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342428032 00000100:00100000:1.0:1782607807.412817:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 36 00000100:00100000:1.0:1782607807.412830:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f40fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32e35a33-83b5-4007-97ba-302ed8efa50a+24:14445:x1869199342428032:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:1.0:1782607807.412867:0:14206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782607807.412896:0:14206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974571007a00/0x8109266df35cc713 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b5862a001bf expref: -99 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607807.412927:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc70c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607807.412936:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974571006e00/0x8109266df35cc70c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607807.412984:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974571007a00/0x8109266df35cc713 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001bf expref: 25 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607807.413024:0:14206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974571007a00/0x8109266df35cc713 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001bf expref: 25 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607807.413053:0:14206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9745432c6c00) 00010000:00010000:1.0:1782607807.413056:0:14206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782607807.413059:0:14206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974571007a00, rc 0) 00000100:00100000:1.0:1782607807.414323:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f40fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32e35a33-83b5-4007-97ba-302ed8efa50a+24:14445:x1869199342428032:12345-192.168.202.4@tcp:101:dd.0 Request processed in 330us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607807.414338:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 36 00000100:00100000:1.0:1782607807.444218:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607807.444402:0:14191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342428288 00000100:00100000:0.0:1782607807.444427:0:14191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342428288 00000100:00100000:0.0:1782607807.444529:0:14191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2 00000100:00100000:0.0:1782607807.444709:0:14191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443760380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32e35a33-83b5-4007-97ba-302ed8efa50a+24:14445:x1869199342428288:12345-192.168.202.4@tcp:103:dd.0 00010000:00010000:0.0:1782607807.444733:0:14191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782607807.444799:0:14191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974571007a00/0x8109266df35cc713 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001bf expref: 24 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.444826:0:14191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9745432c6c00) 00010000:00010000:0.0:1782607807.444849:0:14191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782607807.444960:0:14191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443760380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:32e35a33-83b5-4007-97ba-302ed8efa50a+23:14445:x1869199342428288:12345-192.168.202.4@tcp:103:dd.0 Request processed in 419us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607807.444970:0:14191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2 00000100:00100000:2.0:1782607807.471476:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607807.474524:0:14204:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342428416 00000100:00100000:0.0:1782607807.481017:0:14204:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342428416 00000100:00100000:1.0:1782607807.481367:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 37 00000100:00100000:1.0:1782607807.481386:0:14204:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32e35a33-83b5-4007-97ba-302ed8efa50a+23:14445:x1869199342428416:12345-192.168.202.4@tcp:58:dd.0 00010000:00010000:1.0:1782607807.481558:0:14204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff974571006a00/0x8109266df35cc71a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607807.481584:0:14204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974571006a00/0x8109266df35cc71a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607807.481602:0:14204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974571006a00/0x8109266df35cc71a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782607807.493342:0:14204:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782607807.493552:0:14204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00010000:00010000:0.0:1782607807.493574:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782607807.494223:0:14204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1782607807.494730:0:14204:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32e35a33-83b5-4007-97ba-302ed8efa50a+23:14445:x1869199342428416:12345-192.168.202.4@tcp:58:dd.0 Request processed in 13342us (23268us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607807.494742:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 37 00000100:00100000:3.0:1782607807.508936:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607807.509274:0:15978:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342428544 00000100:00100000:2.0:1782607807.509291:0:15978:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342428544 00000100:00100000:2.0:1782607807.509382:0:15978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 38 00000100:00100000:2.0:1782607807.509396:0:15978:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581538700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:32e35a33-83b5-4007-97ba-302ed8efa50a+23:14445:x1869199342428544:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:2.0:1782607807.509451:0:15978:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607807.509481:0:15978:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585adc00/0x8109266df35cc721 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b5862a001c6 expref: -99 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607807.509573:0:15978:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff974571006a00/0x8109266df35cc71a lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607807.509588:0:15978:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585adc00/0x8109266df35cc721 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001c6 expref: 24 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607807.509614:0:15978:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff974571006a00/0x8109266df35cc71a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607807.509629:0:15978:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585adc00/0x8109266df35cc721 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001c6 expref: 24 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607807.509646:0:15978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9745432c6c00) 00010000:00010000:2.0:1782607807.509649:0:15978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782607807.509653:0:15978:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9745585adc00/0x8109266df35cc721 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001c6 expref: 24 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607807.509662:0:15978:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585adc00, rc 0) 00000100:00100000:2.0:1782607807.509748:0:15978:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581538700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:32e35a33-83b5-4007-97ba-302ed8efa50a+24:14445:x1869199342428544:12345-192.168.202.4@tcp:101:dd.0 Request processed in 355us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607807.509756:0:15978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 38 00000100:00100000:3.0:1782607807.561062:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782607807.561105:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974443760a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364435712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782607807.561234:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607807.561463:0:14841:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364435712 00000100:00100000:1.0:1782607807.561475:0:14841:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364435712 00000100:00100000:1.0:1782607807.561569:0:14841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782607807.561581:0:14841:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581539c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364435712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782607807.561636:0:14841:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782607807.561701:0:14841:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581539c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364435712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607807.561709:0:14841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782607807.561791:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974443760a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364435712:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782607807.562617:0:14200:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1782607807.811515:0:14236:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1782607807.811529:0:14236:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782607807.811687:0:14236:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1782607807.811702:0:14236:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1782607807.811935:0:14236:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9745508cad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14236:1869199364435840:192.168.202.4@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1782607807.812459:0:14236:0:(client.c:2701:ptlrpc_set_wait()) set ffff97456dd8f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782607807.816956:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607807.817207:0:14215:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342428672 00000100:00100000:0.0:1782607807.817223:0:14215:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342428672 00000100:00100000:0.0:1782607807.817305:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 0 00000100:00100000:0.0:1782607807.817319:0:14215:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581538e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:32e35a33-83b5-4007-97ba-302ed8efa50a+25:14446:x1869199342428672:12345-192.168.202.4@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1782607807.817475:0:14215:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581538e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:32e35a33-83b5-4007-97ba-302ed8efa50a+25:14446:x1869199342428672:12345-192.168.202.4@tcp:900:lhsmtool_posix.0 Request processed in 158us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607807.817485:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 0 00000100:00100000:2.0:1782607807.822965:0:14236:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9745508cad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14236:1869199364435840:192.168.202.4@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1782607807.827606:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607807.828312:0:14205:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342428800 00000100:00100000:0.0:1782607807.828328:0:14205:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342428800 00000100:00100000:0.0:1782607807.828414:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 39 00000100:00100000:0.0:1782607807.828426:0:14205:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443760a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+24:14446:x1869199342428800:12345-192.168.202.4@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782607807.828474:0:14205:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782607807.828635:0:14205:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443760a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+24:14446:x1869199342428800:12345-192.168.202.4@tcp:53:lhsmtool_posix.0 Request processed in 210us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607807.828644:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 39 00000100:00100000:1.0:1782607807.836551:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607807.836658:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342428928 00000100:00100000:0.0:1782607807.836671:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342428928 00000100:00100000:0.0:1782607807.836759:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 40 00000100:00100000:0.0:1782607807.836811:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32e35a33-83b5-4007-97ba-302ed8efa50a+24:14446:x1869199342428928:12345-192.168.202.4@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1782607807.836946:0:14206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974442877a00/0x8109266df35cc728 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.836971:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974442877a00/0x8109266df35cc728 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.836988:0:14206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974442877a00/0x8109266df35cc728 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.837009:0:14206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974442876a00/0x8109266df35cc72f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.837017:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974442876a00/0x8109266df35cc72f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.837024:0:14206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974442876a00/0x8109266df35cc72f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.837055:0:14206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974442876400/0x8109266df35cc736 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.837079:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974442876400/0x8109266df35cc736 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.837087:0:14206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974442876400/0x8109266df35cc736 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782607807.837157:0:14206:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1782607807.837162:0:14206:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782607807.837185:0:14206:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff974442876400/0x8109266df35cc736 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.837207:0:14206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff974442877a00/0x8109266df35cc728 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.837220:0:14206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974442877a00/0x8109266df35cc728 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.837228:0:14206:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974442877a00/0x8109266df35cc728 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.837236:0:14206:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974442877a00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607807.837242:0:14206:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974442877a00/0x8109266df35cc728 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.837252:0:14206:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974442877a00/0x8109266df35cc728 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.837271:0:14206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97456dd58f00) 00010000:00010000:0.0:1782607807.837276:0:14206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782607807.837283:0:14206:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974442877a00/0x8109266df35cc728 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.837290:0:14206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974442877a00/0x8109266df35cc728 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.837310:0:14206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974442876a00/0x8109266df35cc72f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.837317:0:14206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974442876a00/0x8109266df35cc72f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.837324:0:14206:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974442876a00/0x8109266df35cc72f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.837330:0:14206:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974442876a00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607807.837340:0:14206:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974442876a00/0x8109266df35cc72f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.837347:0:14206:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974442876a00/0x8109266df35cc72f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.837357:0:14206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff974543e72500) 00010000:00010000:0.0:1782607807.837360:0:14206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782607807.837364:0:14206:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974442876a00/0x8109266df35cc72f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.837371:0:14206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974442876a00/0x8109266df35cc72f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.837391:0:14206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974442876400/0x8109266df35cc736 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.837397:0:14206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974442876400/0x8109266df35cc736 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.837404:0:14206:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974442876400/0x8109266df35cc736 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.837410:0:14206:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974442876400 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607807.837412:0:14206:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974442876400/0x8109266df35cc736 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.837418:0:14206:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974442876400/0x8109266df35cc736 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.837426:0:14206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9745432c6c00) 00010000:00010000:0.0:1782607807.837428:0:14206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782607807.837439:0:14206:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974442876400/0x8109266df35cc736 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.837446:0:14206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974442876400/0x8109266df35cc736 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607807.837568:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32e35a33-83b5-4007-97ba-302ed8efa50a+24:14446:x1869199342428928:12345-192.168.202.4@tcp:34:lhsmtool_posix.0 Request processed in 759us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607807.837579:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 40 00000100:00100000:3.0:1782607807.844186:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607807.844336:0:14205:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342429184 00000100:00100000:0.0:1782607807.844358:0:14205:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342429184 00000100:00100000:0.0:1782607807.844460:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 41 00000100:00100000:0.0:1782607807.844477:0:14205:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+24:14446:x1869199342429184:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782607807.844513:0:14205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607807.844559:0:14205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974442877000/0x8109266df35cc73d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b5862a001cd expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.844730:0:14205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974442877c00/0x8109266df35cc744 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.844752:0:14205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974442877c00/0x8109266df35cc744 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.844799:0:14205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974442877c00/0x8109266df35cc744 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782607807.844815:0:14205:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1782607807.844984:0:14205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974442877c00/0x8109266df35cc744 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.844994:0:14205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974442877c00/0x8109266df35cc744 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.845029:0:14205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974442877c00/0x8109266df35cc744 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.845037:0:14205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974442877c00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:0.0:1782607807.845044:0:14205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974442877c00/0x8109266df35cc744 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.845055:0:14205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974442877c00/0x8109266df35cc744 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.845089:0:14205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9745432c6c00) 00010000:00010000:0.0:1782607807.845093:0:14205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782607807.845101:0:14205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974442877c00/0x8109266df35cc744 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.845109:0:14205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974442877c00/0x8109266df35cc744 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.845174:0:14205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974442877000/0x8109266df35cc73d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001cd expref: 26 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.845186:0:14205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97456dd58f00) 00010000:00010000:0.0:1782607807.845189:0:14205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782607807.845193:0:14205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974442877000/0x8109266df35cc73d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001cd expref: 26 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.845203:0:14205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974442877000, rc 0) 00000100:00100000:0.0:1782607807.845314:0:14205:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+25:14446:x1869199342429184:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 Request processed in 840us (1151us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1782607807.845333:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 41 00000100:00100000:1.0:1782607807.849112:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607807.849219:0:15978:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342429312 00000100:00100000:2.0:1782607807.849235:0:15978:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342429312 00000100:00100000:2.0:1782607807.849325:0:15978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 42 00000100:00100000:2.0:1782607807.849341:0:15978:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:32e35a33-83b5-4007-97ba-302ed8efa50a+25:14446:x1869199342429312:12345-192.168.202.4@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1782607807.849553:0:15978:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1782607807.849740:0:15978:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:32e35a33-83b5-4007-97ba-302ed8efa50a+25:14446:x1869199342429312:12345-192.168.202.4@tcp:53:lhsmtool_posix.0 Request processed in 402us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607807.849750:0:15978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 42 00000100:00100000:2.0:1782607807.855742:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607807.862355:0:14205:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342429568 00000100:00100000:0.0:1782607807.862386:0:14205:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342429568 00000100:00100000:0.0:1782607807.862573:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 43 00000100:00100000:0.0:1782607807.862589:0:14205:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745508cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+25:14446:x1869199342429568:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782607807.862634:0:14205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607807.862669:0:14205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974442876400/0x8109266df35cc752 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b5862a001d4 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782607807.866282:0:14205:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:0.0:1782607807.866302:0:14205:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:0.0:1782607807.866378:0:14205:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:0.0:1782607807.867465:0:14205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff974442876a00/0x8109266df35cc759 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.867491:0:14205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974442876a00/0x8109266df35cc759 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.867507:0:14205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974442876a00/0x8109266df35cc759 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.867607:0:14205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974442876400/0x8109266df35cc752 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001d4 expref: 28 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.867645:0:14205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974442876a00/0x8109266df35cc759 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001d4 expref: 27 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.867658:0:14205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff974543e72500) 00010000:00010000:0.0:1782607807.867676:0:14205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782607807.867681:0:14205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974442876a00, rc 0) 00000100:00100000:0.0:1782607807.867837:0:14205:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745508cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+27:14446:x1869199342429568:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 Request processed in 5251us (12118us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1782607807.867849:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 43 00000100:00100000:1.0:1782607807.884309:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607807.884438:0:15978:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342429824 00000100:00100000:2.0:1782607807.884452:0:15978:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342429824 00000100:00100000:2.0:1782607807.884542:0:15978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 44 00000100:00100000:2.0:1782607807.884565:0:15978:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443762300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:32e35a33-83b5-4007-97ba-302ed8efa50a+27:14446:x1869199342429824:12345-192.168.202.4@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1782607807.884658:0:15978:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782607807.884699:0:15978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974442876a00/0x8109266df35cc759 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001d4 expref: 27 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607807.884727:0:15978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff974543e72500) 00010000:00010000:2.0:1782607807.884742:0:15978:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782607807.885090:0:15978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad200/0x8109266df35cc767 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607807.885111:0:15978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad200/0x8109266df35cc767 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607807.885144:0:15978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad200/0x8109266df35cc767 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607807.885169:0:15978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac400/0x8109266df35cc76e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xda223d3f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607807.885176:0:15978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac400/0x8109266df35cc76e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xda223d3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607807.885183:0:15978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac400/0x8109266df35cc76e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xda223d3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607807.885300:0:15978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad200/0x8109266df35cc767 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607807.885310:0:15978:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad200/0x8109266df35cc767 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607807.885318:0:15978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad200/0x8109266df35cc767 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607807.885324:0:15978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ad200 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607807.885330:0:15978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad200/0x8109266df35cc767 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607807.885567:0:15978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad200/0x8109266df35cc767 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607807.885581:0:15978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9745454f5200) 00010000:00010000:2.0:1782607807.885584:0:15978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607807.885589:0:15978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad200/0x8109266df35cc767 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607807.885603:0:15978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ad200/0x8109266df35cc767 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607807.885616:0:15978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac400/0x8109266df35cc76e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xda223d3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607807.885623:0:15978:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac400/0x8109266df35cc76e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xda223d3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607807.885629:0:15978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac400/0x8109266df35cc76e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xda223d3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607807.885633:0:15978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ac400 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:2.0:1782607807.885637:0:15978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac400/0x8109266df35cc76e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xda223d3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607807.885643:0:15978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac400/0x8109266df35cc76e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xda223d3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607807.885651:0:15978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xda223d3f (ffff9745432c6600) 00010000:00010000:2.0:1782607807.885654:0:15978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782607807.885657:0:15978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac400/0x8109266df35cc76e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xda223d3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607807.885663:0:15978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585ac400/0x8109266df35cc76e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xda223d3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607807.885865:0:15978:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443762300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:32e35a33-83b5-4007-97ba-302ed8efa50a+26:14446:x1869199342429824:12345-192.168.202.4@tcp:36:lhsmtool_posix.0 Request processed in 1299us (1569us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782607807.885875:0:15978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 44 00000100:00100000:2.0:1782607807.905116:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607807.905330:0:14204:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342429952 00000100:00100000:3.0:1782607807.905349:0:14204:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342429952 00000100:00100000:3.0:1782607807.905496:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 45 00000100:00100000:3.0:1782607807.905512:0:14204:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f385880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32e35a33-83b5-4007-97ba-302ed8efa50a+26:14446:x1869199342429952:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782607807.905544:0:14204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607807.905580:0:14204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cc775 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b5862a001db expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607807.905631:0:14204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cc77c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607807.905649:0:14204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cc77c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607807.905663:0:14204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cc77c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607807.905966:0:14204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cc775 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001db expref: 28 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607807.906002:0:14204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649a00/0x8109266df35cc77c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001db expref: 27 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607807.906013:0:14204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9745454f5f00) 00010000:00010000:3.0:1782607807.906017:0:14204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1782607807.906021:0:14204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97455d649a00, rc 0) 00000100:00100000:3.0:1782607807.906124:0:14204:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f385880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32e35a33-83b5-4007-97ba-302ed8efa50a+27:14446:x1869199342429952:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 Request processed in 618us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607807.906133:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 45 00000100:00100000:1.0:1782607807.916803:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607807.916904:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342430208 00000100:00100000:0.0:1782607807.916921:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342430208 00000100:00100000:0.0:1782607807.917016:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 46 00000100:00100000:0.0:1782607807.917036:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443761f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32e35a33-83b5-4007-97ba-302ed8efa50a+27:14446:x1869199342430208:12345-192.168.202.4@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1782607807.917211:0:14206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974442876400/0x8109266df35cc783 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.917239:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974442876400/0x8109266df35cc783 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.917258:0:14206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974442876400/0x8109266df35cc783 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782607807.917920:0:14206:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1782607807.917938:0:14206:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 466764171667ns, next at 467764167815ns, rc = 0 00000004:00010000:0.0:1782607807.918609:0:14206:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ab861a41 reply state 00000000d40185c2 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff974442876400/0x8109266df35cc783 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607807.918629:0:14206:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782607807.919198:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443761f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32e35a33-83b5-4007-97ba-302ed8efa50a+29:14446:x1869199342430208:12345-192.168.202.4@tcp:36:lhsmtool_posix.0 Request processed in 2159us (2433us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1782607807.919210:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 46 00000100:00100000:2.0:1782607807.929611:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:1.0:1782607807.929741:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974442876400/0x8109266df35cc783 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607807.929758:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974442876400/0x8109266df35cc783 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607807.929804:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974442876400/0x8109266df35cc783 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607807.929812:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974442876400 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:1.0:1782607807.929820:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974442876400/0x8109266df35cc783 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607807.929830:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974442876400/0x8109266df35cc783 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607807.929884:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9745454f5f00) 00010000:00010000:1.0:1782607807.929888:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782607807.929894:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974442876400/0x8109266df35cc783 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607807.929902:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974442876400/0x8109266df35cc783 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607807.930021:0:14205:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342430336 00000100:00100000:0.0:1782607807.930036:0:14205:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342430336 00000100:00100000:0.0:1782607807.930158:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 47 00000100:00100000:0.0:1782607807.930170:0:14205:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+28:14446:x1869199342430336:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782607807.930208:0:14205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782607807.930235:0:14205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974442877000/0x8109266df35cc78a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b5862a001e2 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.930331:0:14205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974442877000/0x8109266df35cc78a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001e2 expref: 29 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.930351:0:14205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff974442877000/0x8109266df35cc78a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001e2 expref: 29 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607807.930376:0:14205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9745454f5f00) 00010000:00010000:0.0:1782607807.930379:0:14205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782607807.930382:0:14205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff974442877000, rc 0) 00000100:00100000:0.0:1782607807.930475:0:14205:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+29:14446:x1869199342430336:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 Request processed in 306us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607807.930484:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 47 00000100:00100000:2.0:1782607807.935966:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607807.936243:0:14839:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342430464 00000100:00100000:0.0:1782607807.936259:0:14839:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342430464 00000100:00100000:0.0:1782607807.936364:0:14839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 12 00000100:00100000:0.0:1782607807.936378:0:14839:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f386680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+5:2356:x1869199342430464:12345-192.168.202.4@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1782607807.938089:0:14839:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f386680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+6:2356:x1869199342430464:12345-192.168.202.4@tcp:2:lhsmtool_posix.0 Request processed in 1688us (2129us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1782607807.938106:0:14839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 12 00000100:00100000:1.0:1782607807.951661:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607807.951804:0:14207:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342430720 00000100:00100000:0.0:1782607807.951842:0:14207:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342430720 00000100:00100000:0.0:1782607807.951957:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 9 00000100:00100000:0.0:1782607807.951971:0:14207:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443763b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:32e35a33-83b5-4007-97ba-302ed8efa50a+29:14446:x1869199342430720:12345-192.168.202.4@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1782607807.952422:0:14207:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443763b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:32e35a33-83b5-4007-97ba-302ed8efa50a+30:14446:x1869199342430720:12345-192.168.202.4@tcp:35:lhsmtool_posix.0 Request processed in 451us (782us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1782607807.952432:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 9 00000100:00100000:0.0:1782607807.956284:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607807.956427:0:15978:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342430976 00000100:00100000:2.0:1782607807.956443:0:15978:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342430976 00000100:00100000:2.0:1782607807.956528:0:15978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 48 00000100:00100000:2.0:1782607807.956543:0:15978:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:32e35a33-83b5-4007-97ba-302ed8efa50a+30:14446:x1869199342430976:12345-192.168.202.4@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1782607807.956736:0:15978:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:32e35a33-83b5-4007-97ba-302ed8efa50a+30:14446:x1869199342430976:12345-192.168.202.4@tcp:57:lhsmtool_posix.0 Request processed in 196us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607807.956746:0:15978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 48 00000100:00100000:2.0:1782607807.965674:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607807.965898:0:14205:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342431104 00000100:00100000:3.0:1782607807.965915:0:14205:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342431104 00000100:00100000:3.0:1782607807.966030:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 49 00000100:00100000:3.0:1782607807.966046:0:14205:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f386a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+30:14446:x1869199342431104:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782607807.966092:0:14205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607807.966131:0:14205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cc791 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b5862a001e9 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607807.966248:0:14205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648600/0x8109266df35cc798 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607807.966270:0:14205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648600/0x8109266df35cc798 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607807.966287:0:14205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648600/0x8109266df35cc798 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782607807.966352:0:14205:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782607807.966412:0:14205:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648600/0x8109266df35cc798 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607807.966450:0:14205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649600/0x8109266df35cc791 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001e9 expref: 32 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607807.966476:0:14205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648600/0x8109266df35cc798 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001e9 expref: 31 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607807.966486:0:14205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9745454f5f00) 00010000:00010000:3.0:1782607807.966490:0:14205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1782607807.966496:0:14205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97455d648600, rc 0) 00000100:00100000:3.0:1782607807.966600:0:14205:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f386a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+31:14446:x1869199342431104:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 Request processed in 558us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607807.966609:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 49 00000100:00100000:0.0:1782607807.977299:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607807.977380:0:15977:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342431232 00000100:00100000:3.0:1782607807.977394:0:15977:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342431232 00000100:00100000:3.0:1782607807.977494:0:15977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 13 00000100:00100000:3.0:1782607807.977507:0:15977:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458100aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:32e35a33-83b5-4007-97ba-302ed8efa50a+6:2357:x1869199342431232:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782607807.977536:0:15977:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782607807.977576:0:15977:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009cfa653d/0x8109266df35cc79f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b5862a001f0 expref: -99 pid: 15977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782607807.977614:0:15977:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a406fc0, blocks: 0x1 00010000:00010000:3.0:1782607807.977641:0:15977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=466s v=(0 0) 00010000:00010000:3.0:1782607807.977646:0:15977:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782607807.977659:0:15977:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cfa653d/0x8109266df35cc79f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001f0 expref: 7 pid: 15977 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607807.977713:0:15977:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009cfa653d/0x8109266df35cc79f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001f0 expref: 7 pid: 15977 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607807.977729:0:15977:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97455d649e00, rc 0) 00000100:00100000:3.0:1782607807.977863:0:15977:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458100aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:32e35a33-83b5-4007-97ba-302ed8efa50a+7:2357:x1869199342431232:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 Request processed in 358us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607807.977872:0:15977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 13 00000100:00100000:2.0:1782607807.982030:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607807.982148:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342431488 00000100:00100000:0.0:1782607807.982164:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342431488 00000100:00100000:0.0:1782607807.982241:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 50 00000100:00100000:0.0:1782607807.982253:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f387100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32e35a33-83b5-4007-97ba-302ed8efa50a+31:14446:x1869199342431488:12345-192.168.202.4@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1782607807.982413:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f387100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32e35a33-83b5-4007-97ba-302ed8efa50a+31:14446:x1869199342431488:12345-192.168.202.4@tcp:57:lhsmtool_posix.0 Request processed in 161us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607807.982421:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 50 00000100:00100000:2.0:1782607807.987916:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607807.988046:0:14205:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342431616 00000100:00100000:3.0:1782607807.988059:0:14205:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342431616 00000100:00100000:3.0:1782607807.988149:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 51 00000100:00100000:3.0:1782607807.988161:0:14205:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f385c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+31:14446:x1869199342431616:12345-192.168.202.4@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1782607808.094118:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1782607808.094136:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1782607808.094168:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:1.0:1782607808.094193:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:1.0:1782607808.094206:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:1.0:1782607808.094422:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364435968:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1782607808.094494:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607808.094619:0:14840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364435968 00000100:00100000:0.0:1782607808.094628:0:14840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364435968 00000100:00100000:0.0:1782607808.094713:0:14840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782607808.094723:0:14840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364435968:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1782607808.094918:0:14840:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1782607808.094922:0:14840:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1782607808.094925:0:14840:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1782607808.094927:0:14840:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1782607808 -> 1782607808 00002000:00010000:0.0:1782607808.094930:0:14840:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1782607808.094988:0:14840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443762d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3319:x1869199364435968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 267us (494us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1782607808.095013:0:14840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:0.0:1782607808.095075:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff974581008380/2, rc 0, transno 8589934595 00000100:00100000:0.0:1782607808.095081:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364435968:0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1782607808.095321:0:14200:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782607808.096086:0:14205:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f385c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+14:14446:x1869199342431616:12345-192.168.202.4@tcp:44:lhsmtool_posix.0 Request processed in 107923us (108184us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607808.096098:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 51 00000100:00100000:1.0:1782607808.102089:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607808.102220:0:15977:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342431744 00000100:00100000:3.0:1782607808.102231:0:15977:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342431744 00000100:00100000:3.0:1782607808.102333:0:15977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15 00000100:00100000:3.0:1782607808.102345:0:15977:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443763480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:32e35a33-83b5-4007-97ba-302ed8efa50a+7:2356:x1869199342431744:12345-192.168.202.4@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1782607808.102486:0:15977:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443763480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:32e35a33-83b5-4007-97ba-302ed8efa50a+7:2356:x1869199342431744:12345-192.168.202.4@tcp:16:lhsmtool_posix.0 Request processed in 142us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607808.102494:0:15977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15 00000100:00080000:1.0:1782607808.102568:0:14200:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782607808.113242:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607808.113451:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342432000 00000100:00100000:0.0:1782607808.113463:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342432000 00000100:00100000:0.0:1782607808.113600:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 52 00000100:00100000:0.0:1782607808.113612:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f385f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32e35a33-83b5-4007-97ba-302ed8efa50a+14:14446:x1869199342432000:12345-192.168.202.4@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1782607808.113669:0:14206:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782607808.113698:0:14206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d648600/0x8109266df35cc798 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001e9 expref: 14 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607808.113720:0:14206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9745454f5f00) 00010000:00010000:0.0:1782607808.113726:0:14206:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782607808.113757:0:14206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974442877a00/0x8109266df35cc7a6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607808.113818:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974442877a00/0x8109266df35cc7a6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607808.113829:0:14206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974442877a00/0x8109266df35cc7a6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782607808.114042:0:14206:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000c3c359f reply state 00000000d5a4255c transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff974442877a00/0x8109266df35cc7a6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607808.114052:0:14206:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782607808.114170:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f385f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:32e35a33-83b5-4007-97ba-302ed8efa50a+15:14446:x1869199342432000:12345-192.168.202.4@tcp:36:lhsmtool_posix.0 Request processed in 561us (940us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1782607808.114197:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 52 00000100:00080000:1.0:1782607808.114664:0:14200:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782607808.131754:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607808.131926:0:14840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342432128 00000100:00100000:2.0:1782607808.131940:0:14840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342432128 00000100:00100000:2.0:1782607808.132047:0:14840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16 00000100:00100000:2.0:1782607808.132070:0:14840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458100b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:32e35a33-83b5-4007-97ba-302ed8efa50a+7:14446:x1869199342432128:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782607808.132098:0:14840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782607808.132134:0:14840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5d4c048/0x8109266df35cc7ad lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a780b5862a001f7 expref: -99 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607808.132192:0:14840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009cfa653d/0x8109266df35cc79f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001f0 expref: 8 pid: 15977 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607808.132204:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782607808.132209:0:14840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782607808.132236:0:14840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5d4c048/0x8109266df35cc7ad lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001f7 expref: 8 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607808.132282:0:14840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009cfa653d/0x8109266df35cc79f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001f0 expref: 8 pid: 15977 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607808.132300:0:14840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009cfa653d/0x8109266df35cc79f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001f0 expref: 8 pid: 15977 timeout: 566 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607808.132320:0:14840:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f385500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:14840:1869199364436096:192.168.202.4@tcp:104: 00000100:00100000:2.0:1782607808.132460:0:14840:0:(client.c:2701:ptlrpc_set_wait()) set ffff97456dd8f480 going to sleep for 11 seconds 00010000:00010000:3.0:1782607808.133440:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff974442877a00/0x8109266df35cc7a6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.133459:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974442877a00/0x8109266df35cc7a6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.133468:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974442877a00/0x8109266df35cc7a6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.133491:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974442877a00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:3.0:1782607808.133497:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974442877a00/0x8109266df35cc7a6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.133507:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974442877a00/0x8109266df35cc7a6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.133529:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9745454f5f00) 00010000:00010000:3.0:1782607808.133541:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782607808.133547:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974442877a00/0x8109266df35cc7a6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.133553:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974442877a00/0x8109266df35cc7a6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607808.135702:0:14840:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f385500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:14840:1869199364436096:192.168.202.4@tcp:104: 00010000:00010000:2.0:1782607808.135750:0:14840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a5d4c048/0x8109266df35cc7ad lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001f7 expref: 8 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607808.135816:0:14840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9745585aca00, rc 0) 00000100:00100000:2.0:1782607808.135893:0:14840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458100b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:32e35a33-83b5-4007-97ba-302ed8efa50a+8:14446:x1869199342432128:12345-192.168.202.4@tcp:101:lhsmtool_posix.0 Request processed in 3834us (4154us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607808.135905:0:14840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16 00000100:00100000:1.0:1782607808.149191:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607808.149373:0:16218:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342432256 00000100:00100000:3.0:1782607808.149388:0:16218:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342432256 00010000:00010000:3.0:1782607808.149451:0:16218:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009cfa653d/0x8109266df35cc79f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001f0 expref: 8 pid: 15977 timeout: 566 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607808.149511:0:16218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 13 00000100:00100000:3.0:1782607808.149523:0:16218:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443760700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:32e35a33-83b5-4007-97ba-302ed8efa50a+8:2357:x1869199342432256:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782607808.149553:0:16218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782607808.149583:0:16218:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009cfa653d/0x8109266df35cc79f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001f0 expref: 8 pid: 15977 timeout: 566 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.149610:0:16218:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009cfa653d/0x8109266df35cc79f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001f0 expref: 8 pid: 15977 timeout: 566 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.149663:0:16218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009cfa653d/0x8109266df35cc79f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001f0 expref: 8 pid: 15977 timeout: 566 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.149688:0:16218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782607808.149693:0:16218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782607808.149701:0:16218:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a5d4c048/0x8109266df35cc7ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001f7 expref: 7 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.149714:0:16218:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5d4c048/0x8109266df35cc7ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001f7 expref: 7 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.149834:0:16218:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a5d4c048/0x8109266df35cc7ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001f7 expref: 7 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607808.149855:0:16218:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974443369180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:16218:1869199364436224:192.168.202.4@tcp:105: 00000100:00100000:3.0:1782607808.149973:0:16218:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745439593c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782607808.159588:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607808.159694:0:15977:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342432384 00000100:00100000:1.0:1782607808.159707:0:15977:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342432384 00000100:00100000:1.0:1782607808.159836:0:15977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17 00000100:00100000:1.0:1782607808.159849:0:15977:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458100a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:32e35a33-83b5-4007-97ba-302ed8efa50a+8:2356:x1869199342432384:12345-192.168.202.4@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1782607808.160162:0:15977:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1782607808.160167:0:15977:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1782607808 00002000:00010000:1.0:1782607808.160170:0:15977:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1782607807 00002000:00010000:1.0:1782607808.160173:0:15977:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1782607808 -> 1782607808 00002000:00010000:1.0:1782607808.160175:0:15977:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1782607808.160254:0:15977:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458100a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:32e35a33-83b5-4007-97ba-302ed8efa50a+9:2356:x1869199342432384:12345-192.168.202.4@tcp:2:lhsmtool_posix.0 Request processed in 407us (680us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1782607808.160264:0:15977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17 00000100:00100000:3.0:1782607808.163116:0:16218:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974443369180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:16218:1869199364436224:192.168.202.4@tcp:105: 00010000:00010000:3.0:1782607808.163187:0:16218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782607808.163805:0:16218:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443760700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:32e35a33-83b5-4007-97ba-302ed8efa50a+8:2357:x1869199342432256:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 14278us (14623us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607808.163822:0:16218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 13 00000100:00100000:0.0:1782607808.167920:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607808.168131:0:14839:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342432512 00000100:00100000:2.0:1782607808.168144:0:14839:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342432512 00000100:00100000:2.0:1782607808.168250:0:14839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 18 00000100:00100000:2.0:1782607808.168262:0:14839:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+8:2357:x1869199342432512:12345-192.168.202.4@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1782607808.168343:0:14839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000fa915ac/0x8109266df35cc7b4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607808.168368:0:14839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a5d4c048/0x8109266df35cc7ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001f7 expref: 8 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607808.168379:0:14839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1782607808.168385:0:14839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782607808.168390:0:14839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fa915ac/0x8109266df35cc7b4 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607808.168432:0:14839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a5d4c048/0x8109266df35cc7ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001f7 expref: 8 pid: 14840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607808.168449:0:14839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a5d4c048/0x8109266df35cc7ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001f7 expref: 8 pid: 14840 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607808.168467:0:14839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f385500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:14839:1869199364436352:192.168.202.4@tcp:104: 00000100:00100000:2.0:1782607808.168572:0:14839:0:(client.c:2701:ptlrpc_set_wait()) set ffff97456dd8f480 going to sleep for 11 seconds 00000100:00100000:2.0:1782607808.171847:0:14839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f385500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:14839:1869199364436352:192.168.202.4@tcp:104: 00010000:00010000:2.0:1782607808.171885:0:14839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000fa915ac/0x8109266df35cc7b4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607808.172966:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607808.173080:0:14189:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342432640 00000100:00100000:2.0:1782607808.173091:0:14189:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342432640 00010000:00010000:2.0:1782607808.173279:0:14189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a5d4c048/0x8109266df35cc7ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001f7 expref: 9 pid: 14840 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607808.173332:0:14189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 14 00000100:00100000:2.0:1782607808.173344:0:14189:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581009500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32e35a33-83b5-4007-97ba-302ed8efa50a+9:2356:x1869199342432640:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782607808.173363:0:14189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782607808.173391:0:14189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a5d4c048/0x8109266df35cc7ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001f7 expref: 9 pid: 14840 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607808.173407:0:14189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a5d4c048/0x8109266df35cc7ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001f7 expref: 9 pid: 14840 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607808.173439:0:14189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5d4c048/0x8109266df35cc7ad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001f7 expref: 9 pid: 14840 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607808.173461:0:14189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782607808.173466:0:14189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782607808.173474:0:14189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000fa915ac/0x8109266df35cc7b4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607808.173487:0:14189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fa915ac/0x8109266df35cc7b4 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607808.173520:0:14189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782607808.173592:0:14189:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581009500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:32e35a33-83b5-4007-97ba-302ed8efa50a+8:2356:x1869199342432640:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 249us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607808.173610:0:14189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 14 00010000:00010000:3.0:1782607808.173818:0:14839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000fa915ac/0x8109266df35cc7b4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.173830:0:14839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000fa915ac/0x8109266df35cc7b4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.173873:0:14839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000fa915ac/0x8109266df35cc7b4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.173882:0:14839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000fa915ac/0x8109266df35cc7b4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.173891:0:14839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000fa915ac/0x8109266df35cc7b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.173899:0:14839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ad200 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:3.0:1782607808.173905:0:14839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000fa915ac/0x8109266df35cc7b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.173914:0:14839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000fa915ac/0x8109266df35cc7b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.173927:0:14839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000fa915ac/0x8109266df35cc7b4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.173935:0:14839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000fa915ac/0x8109266df35cc7b4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607808.173993:0:14839:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+7:2357:x1869199342432512:12345-192.168.202.4@tcp:1:lhsmtool_posix.0 Request processed in 5733us (6090us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607808.174010:0:14839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 18 00000100:00100000:0.0:1782607808.189325:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607808.189800:0:14204:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342432896 00000100:00100000:1.0:1782607808.189816:0:14204:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342432896 00000100:00100000:1.0:1782607808.189888:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 53 00000100:00100000:1.0:1782607808.189899:0:14204:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32e35a33-83b5-4007-97ba-302ed8efa50a+14:14446:x1869199342432896:12345-192.168.202.4@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1782607808.190010:0:14204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc7bb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607808.190033:0:14204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc7bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607808.190048:0:14204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc7bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607808.190425:0:14204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc7c2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607808.190439:0:14204:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff974442877000/0x8109266df35cc78a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001e2 expref: 15 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607808.190448:0:14204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc7c2 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607808.190498:0:14204:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff974442877000/0x8109266df35cc78a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001e2 expref: 15 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607808.190516:0:14204:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff974442877000/0x8109266df35cc78a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001e2 expref: 15 pid: 14205 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607808.190535:0:14204:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974443762680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14204:1869199364436480:192.168.202.4@tcp:104: 00000100:00100000:1.0:1782607808.191369:0:14204:0:(client.c:2701:ptlrpc_set_wait()) set ffff974543a11a80 going to sleep for 11 seconds 00000100:00100000:3.0:1782607808.204355:0:14204:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974443762680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14204:1869199364436480:192.168.202.4@tcp:104: 00010000:00010000:3.0:1782607808.204404:0:14204:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc7c2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607808.210413:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607808.210645:0:14190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342433024 00000100:00100000:2.0:1782607808.210660:0:14190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342433024 00010000:00010000:2.0:1782607808.210728:0:14190:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff974442877000/0x8109266df35cc78a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001e2 expref: 16 pid: 14205 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607808.210837:0:14190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15 00000100:00100000:2.0:1782607808.210850:0:14190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974581009880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+16:2357:x1869199342433024:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782607808.210872:0:14190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782607808.210880:0:14190:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff974442877000/0x8109266df35cc78a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001e2 expref: 16 pid: 14205 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607808.210896:0:14190:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff974442877000/0x8109266df35cc78a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001e2 expref: 16 pid: 14205 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607808.210927:0:14190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974442877000/0x8109266df35cc78a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001e2 expref: 16 pid: 14205 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607808.210952:0:14190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9745454f5f00) 00010000:00010000:2.0:1782607808.210959:0:14190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc7c2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607808.210970:0:14190:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc7c2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607808.210979:0:14190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc7c2 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607808.211041:0:14190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782607808.211130:0:14190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581009880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+15:2357:x1869199342433024:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 282us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607808.211139:0:14190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15 00010000:00010000:3.0:1782607808.211637:0:14204:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc7c2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.211648:0:14204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc7c2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782607808.211983:0:14204:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:3.0:1782607808.212538:0:14204:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:3.0:1782607808.212596:0:14204:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:3.0:1782607808.212701:0:14204:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974443369180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14204:1869199364436608:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1782607808.212922:0:14204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607808.212964:0:14204:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745498bd300 going to sleep for 11 seconds 00000100:00100000:0.0:1782607808.214319:0:14209:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364436608 00000100:00100000:0.0:1782607808.214334:0:14209:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364436608 00000100:00100000:0.0:1782607808.214415:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782607808.214428:0:14209:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455d460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14204:x1869199364436608:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1782607808.214612:0:14209:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455d460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14204:x1869199364436608:12345-0@lo:1000:mdt00_000.0 Request processed in 185us (1688us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607808.214622:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782607808.214841:0:14204:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974443369180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14204:1869199364436608:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1782607808.220239:0:14204:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1782607808.220382:0:14204:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d460700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14204:1869199364436736:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1782607808.220533:0:14204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782607808.220588:0:14204:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745439593c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782607808.221656:0:14209:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364436736 00000100:00100000:0.0:1782607808.221673:0:14209:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364436736 00000100:00100000:0.0:1782607808.221794:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782607808.221808:0:14209:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455d463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14204:x1869199364436736:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1782607808.222237:0:14209:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455d463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14204:x1869199364436736:12345-0@lo:1000:mdt00_000.0 Request processed in 430us (1705us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1782607808.222249:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782607808.227223:0:14204:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d460700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14204:1869199364436736:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1782607808.227311:0:14204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc7c2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.227325:0:14204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc7c2 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.227366:0:14204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc7c2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.227374:0:14204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974571006600 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:3.0:1782607808.227381:0:14204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc7c2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.227390:0:14204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc7c2 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.227415:0:14204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9745454f5f00) 00010000:00010000:3.0:1782607808.227418:0:14204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782607808.227423:0:14204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc7c2 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.227431:0:14204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974571006600/0x8109266df35cc7c2 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.227485:0:14204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff974571006a00/0x8109266df35cc71a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.227492:0:14204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974571006a00/0x8109266df35cc71a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.227497:0:14204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974571006a00/0x8109266df35cc71a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.227503:0:14204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974571006a00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:3.0:1782607808.227507:0:14204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974571006a00/0x8109266df35cc71a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.227522:0:14204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974571006a00/0x8109266df35cc71a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.227531:0:14204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9745432c6c00) 00010000:00010000:3.0:1782607808.227533:0:14204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782607808.227544:0:14204:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9745585adc00/0x8109266df35cc721 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001c6 expref: 18 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.227560:0:14204:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9745585adc00/0x8109266df35cc721 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001c6 expref: 18 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.227573:0:14204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9745585adc00/0x8109266df35cc721 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001c6 expref: 18 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.227661:0:14204:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9745585adc00/0x8109266df35cc721 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x6a780b5862a001c6 expref: 18 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607808.227681:0:14204:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97455d462a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14204:1869199364436864:192.168.202.4@tcp:105: 00000100:00100000:3.0:1782607808.237194:0:14204:0:(client.c:2701:ptlrpc_set_wait()) set ffff9745439593c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782607808.249900:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607808.250132:0:14207:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342433152 00000100:00100000:2.0:1782607808.250166:0:14207:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342433152 00000100:00100000:2.0:1782607808.250267:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 10 00000100:00100000:2.0:1782607808.250285:0:14207:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455113d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:32e35a33-83b5-4007-97ba-302ed8efa50a+19:14445:x1869199342433152:12345-192.168.202.4@tcp:49:dd.0 00000100:00100000:2.0:1782607808.250565:0:14207:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455113d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:32e35a33-83b5-4007-97ba-302ed8efa50a+19:14445:x1869199342433152:12345-192.168.202.4@tcp:49:dd.0 Request processed in 284us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607808.250578:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 10 00000100:00100000:3.0:1782607808.250866:0:14204:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97455d462a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14204:1869199364436864:192.168.202.4@tcp:105: 00010000:00010000:3.0:1782607808.250916:0:14204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974571006a00/0x8109266df35cc71a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.250934:0:14204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974571006a00/0x8109266df35cc71a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.250994:0:14204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cc7c9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.251045:0:14204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cc7c9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.251078:0:14204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cc7c9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.251097:0:14204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cc7c9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.251106:0:14204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cc7c9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.251114:0:14204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cc7c9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.251122:0:14204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d649e00 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:3.0:1782607808.251128:0:14204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cc7c9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.251137:0:14204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cc7c9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.251155:0:14204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9745432c6c00) 00010000:00010000:3.0:1782607808.251160:0:14204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782607808.251165:0:14204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cc7c9 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.251173:0:14204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97455d649e00/0x8109266df35cc7c9 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.251186:0:14204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc7bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.251202:0:14204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc7bb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.251210:0:14204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc7bb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.251216:0:14204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974571006400 already unused, calling callback (ffffffffc21d34f0) 00010000:00010000:3.0:1782607808.251220:0:14204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc7bb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.251226:0:14204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc7bb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.251237:0:14204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9745432c6c00) 00010000:00010000:3.0:1782607808.251240:0:14204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1782607808.251244:0:14204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc7bb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.251250:0:14204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974571006400/0x8109266df35cc7bb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14204 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607808.251651:0:14204:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974581008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:32e35a33-83b5-4007-97ba-302ed8efa50a+18:14446:x1869199342432896:12345-192.168.202.4@tcp:57:lhsmtool_posix.0 Request processed in 61750us (62339us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1782607808.251664:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 53 00000020:00080000:3.0:1782607808.251673:0:14204:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1782607808.255484:0:14236:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1782607808.255501:0:14236:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782607808.255558:0:14236:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1782607808.255568:0:14236:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1782607808.263723:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607808.265323:0:14207:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342433408 00000100:00100000:2.0:1782607808.265346:0:14207:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342433408 00000100:00100000:2.0:1782607808.265449:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 11 00000100:00100000:2.0:1782607808.265462:0:14207:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455d462a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:32e35a33-83b5-4007-97ba-302ed8efa50a+18:14446:x1869199342433408:12345-192.168.202.4@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1782607808.268658:0:14207:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1782607808.268833:0:14207:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1782607808.268938:0:14207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974442876e00/0x8109266df35cc7d0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607808.271414:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff974442876e00/0x8109266df35cc7d0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607808.271435:0:14207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff974442876e00/0x8109266df35cc7d0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607808.271448:0:14207:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974442876e00/0x8109266df35cc7d0 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607808.271455:0:14207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff974442876e00/0x8109266df35cc7d0 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607808.271462:0:14207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff974442876e00/0x8109266df35cc7d0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607808.271504:0:14207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782607808.271685:0:14207:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455d462a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:32e35a33-83b5-4007-97ba-302ed8efa50a+20:14446:x1869199342433408:12345-192.168.202.4@tcp:35:lhsmtool_posix.0 Request processed in 6218us (7976us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1782607808.271699:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 11 00000020:00080000:0.0:1782607808.271709:0:14207:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782607808.272459:0:14192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782607808.272471:0:14192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff974442876e00/0x8109266df35cc7d0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.272494:0:14192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974442876e00 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:3.0:1782607808.272498:0:14192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974442876e00/0x8109266df35cc7d0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.272507:0:14192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff974442876e00/0x8109266df35cc7d0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.272525:0:14192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9745454f5f00) 00010000:00010000:3.0:1782607808.272528:0:14192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782607808.272532:0:14192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff974442876e00/0x8109266df35cc7d0 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.272538:0:14192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff974442876e00/0x8109266df35cc7d0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.272553:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607808.272554:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782607808.272555:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782607808.520074:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782607808.535382:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607808.535454:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607808.535628:0:14843:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342433664 00000100:00100000:1.0:1782607808.535640:0:14843:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342433664 00000100:00100000:1.0:1782607808.535733:0:14843:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342433536 00000100:00100000:1.0:1782607808.535737:0:14843:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342433536 00000100:00100000:1.0:1782607808.535761:0:14843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 0 00000100:00100000:3.0:1782607808.535821:0:14844:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1782607808.535828:0:14843:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f385500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:32e35a33-83b5-4007-97ba-302ed8efa50a+8:2354:x1869199342433664:12345-192.168.202.4@tcp:4:dd.0 00000100:00100000:3.0:1782607808.535841:0:14844:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00002000:00010000:1.0:1782607808.535910:0:14843:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a406fc0, atime: 0x6a406fbf, ctime: 0x6a406fc0, blocks: 0x1 00010000:00010000:1.0:1782607808.535924:0:14843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078a5fb9b/0x8109266df35cc7d7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607808.535948:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=467s v=(0 0) 00010000:00010000:1.0:1782607808.535954:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607808.535963:0:14843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078a5fb9b/0x8109266df35cc7d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607808.535982:0:14843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078a5fb9b/0x8109266df35cc7d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607808.540245:0:16333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1 00000100:00100000:1.0:1782607808.540273:0:16333:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f386d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:32e35a33-83b5-4007-97ba-302ed8efa50a+9:2354:x1869199342433536:12345-192.168.202.4@tcp:4:dd.0 00010000:00010000:1.0:1782607808.540336:0:16333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029163cdc/0x8109266df35cc7de lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607808.540359:0:16333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607808.540364:0:16333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607808.540372:0:16333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029163cdc/0x8109266df35cc7de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607808.540388:0:16333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029163cdc/0x8109266df35cc7de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607808.542381:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607808.542564:0:14845:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1782607808.542577:0:14845:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1782607808.543050:0:14845:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342433792 00000100:00100000:2.0:1782607808.543069:0:14845:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342433792 00000100:00100000:3.0:1782607808.543592:0:16334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2 00000100:00100000:3.0:1782607808.543604:0:16334:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:32e35a33-83b5-4007-97ba-302ed8efa50a+10:2355:x1869199342433792:12345-192.168.202.4@tcp:4:dd.0 00010000:00010000:3.0:1782607808.543810:0:16334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000407a177c/0x8109266df35cc7e5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.543830:0:16334:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782607808.543835:0:16334:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782607808.543850:0:16334:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000407a177c/0x8109266df35cc7e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.543866:0:16334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000407a177c/0x8109266df35cc7e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782607808.548920:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1782607808.549449:0:14845:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:2.0:1782607808.549460:0:14845:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:2.0:1782607808.549644:0:14845:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342433920 00000100:00100000:2.0:1782607808.549658:0:14845:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342433920 00000100:00100000:2.0:1782607808.550582:0:16335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 3 00000100:00100000:2.0:1782607808.550599:0:16335:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97458100bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:32e35a33-83b5-4007-97ba-302ed8efa50a+11:2355:x1869199342433920:12345-192.168.202.4@tcp:4:dd.0 00010000:00010000:2.0:1782607808.550641:0:16335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a623def/0x8109266df35cc7ec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607808.550660:0:16335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782607808.550666:0:16335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782607808.550673:0:16335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a623def/0x8109266df35cc7ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607808.550688:0:16335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a623def/0x8109266df35cc7ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607808.555102:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607808.555212:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607808.555231:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1782607808.555254:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607808.557746:0:14845:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 6 min 3 max 116 00000100:00100000:0.0:1782607808.557779:0:14845:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_006' 00000100:00100000:0.0:1782607808.557924:0:14844:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 6 min 3 max 116 00000100:00100000:0.0:1782607808.557935:0:14844:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342434176 00000100:00100000:0.0:1782607808.557943:0:14844:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342434176 00000100:00100000:0.0:1782607808.557998:0:14844:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 6 min 3 max 116 00000100:00100000:0.0:1782607808.558004:0:14844:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342434048 00000100:00100000:0.0:1782607808.558007:0:14844:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342434048 00000100:00100000:0.0:1782607808.558021:0:14844:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 6 min 3 max 116 00000100:00100000:0.0:1782607808.558032:0:14844:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342434304 00000100:00100000:0.0:1782607808.558036:0:14844:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342434304 00000100:00100000:0.0:1782607808.558052:0:14844:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 6 min 3 max 116 00000100:00100000:0.0:1782607808.558071:0:14844:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342434432 00000100:00100000:0.0:1782607808.558074:0:14844:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342434432 00000100:00100000:0.0:1782607808.558495:0:16336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4 00000100:00100000:0.0:1782607808.558507:0:16336:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455d463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:32e35a33-83b5-4007-97ba-302ed8efa50a+17:2354:x1869199342434176:12345-192.168.202.4@tcp:4:dd.0 00010000:00010000:0.0:1782607808.558562:0:16336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000700af607/0x8109266df35cc7f3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607808.558580:0:16336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607808.558585:0:16336:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782607808.558591:0:16336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000700af607/0x8109266df35cc7f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782607808.558604:0:16336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000700af607/0x8109266df35cc7f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782607808.707704:0:7525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:0.0:1782607808.707724:0:7525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000001:00080000:0.0:1782607808.707737:0:7525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00080000:0.0:1782607808.707750:0:7525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00002000:00010000:1.0:1782607808.708123:0:16335:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 6291456 00002000:00010000:1.0:1782607808.708129:0:16335:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1782607808 -> 1782607809 00002000:00010000:1.0:1782607808.708133:0:16335:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1782607808 -> 1782607809 00002000:00010000:1.0:1782607808.708135:0:16335:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:1.0:1782607808.708152:0:16335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a623def/0x8109266df35cc7ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607808.708166:0:16335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a623def/0x8109266df35cc7ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607808.708175:0:16335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a623def/0x8109266df35cc7ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607808.708206:0:16335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ad600 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:1.0:1782607808.708212:0:16335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a623def/0x8109266df35cc7ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607808.708222:0:16335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a623def/0x8109266df35cc7ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607808.708242:0:16335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a623def/0x8109266df35cc7ec lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607808.708249:0:16335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a623def/0x8109266df35cc7ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607808.708386:0:16335:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97458100bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:32e35a33-83b5-4007-97ba-302ed8efa50a+22:2355:x1869199342433920:12345-192.168.202.4@tcp:4:dd.0 Request processed in 157787us (159472us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1782607808.708397:0:16335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 3 00000100:00100000:1.0:1782607808.708434:0:16335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5 00000100:00100000:1.0:1782607808.708445:0:16335:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455d461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:32e35a33-83b5-4007-97ba-302ed8efa50a+21:2354:x1869199342434048:12345-192.168.202.4@tcp:4:dd.0 00010000:00010000:1.0:1782607808.708476:0:16335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f0afe6f/0x8109266df35cc7fa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607808.708489:0:16335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607808.708493:0:16335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607808.708499:0:16335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f0afe6f/0x8109266df35cc7fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607808.708632:0:16335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f0afe6f/0x8109266df35cc7fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607808.709381:0:14843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078a5fb9b/0x8109266df35cc7d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607808.709394:0:14843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078a5fb9b/0x8109266df35cc7d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607808.709400:0:14843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078a5fb9b/0x8109266df35cc7d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607808.709406:0:14843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974571006e00 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:2.0:1782607808.709411:0:14843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078a5fb9b/0x8109266df35cc7d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607808.709432:0:14843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078a5fb9b/0x8109266df35cc7d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607808.709446:0:14843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078a5fb9b/0x8109266df35cc7d7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607808.709453:0:14843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078a5fb9b/0x8109266df35cc7d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607808.709510:0:14843:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f385500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:32e35a33-83b5-4007-97ba-302ed8efa50a+21:2354:x1869199342433664:12345-192.168.202.4@tcp:4:dd.0 Request processed in 173689us (174146us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1782607808.709719:0:14843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 0 00000100:00100000:2.0:1782607808.709746:0:14843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 6 00000100:00100000:2.0:1782607808.709756:0:14843:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455d461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:32e35a33-83b5-4007-97ba-302ed8efa50a+20:2355:x1869199342434304:12345-192.168.202.4@tcp:4:dd.0 00010000:00010000:2.0:1782607808.709808:0:14843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059d3f2d8/0x8109266df35cc801 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607808.709821:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782607808.709825:0:14843:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782607808.709831:0:14843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059d3f2d8/0x8109266df35cc801 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607808.709841:0:14843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059d3f2d8/0x8109266df35cc801 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782607808.777040:0:7525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00000001:00080000:1.0:1782607808.777072:0:7525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00002000:00010000:1.0:1782607808.777205:0:16333:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:1.0:1782607808.777210:0:16333:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 10247 00010000:00010000:1.0:1782607808.777226:0:16333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029163cdc/0x8109266df35cc7de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607808.777239:0:16333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029163cdc/0x8109266df35cc7de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607808.777249:0:16333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029163cdc/0x8109266df35cc7de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607808.777255:0:16333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974571007a00 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:1.0:1782607808.777260:0:16333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029163cdc/0x8109266df35cc7de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607808.777268:0:16333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029163cdc/0x8109266df35cc7de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607808.777288:0:16333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029163cdc/0x8109266df35cc7de lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607808.777324:0:16333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029163cdc/0x8109266df35cc7de lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607808.780387:0:16333:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f386d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:32e35a33-83b5-4007-97ba-302ed8efa50a+18:2354:x1869199342433536:12345-192.168.202.4@tcp:4:dd.0 Request processed in 240109us (244915us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1782607808.780405:0:16333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1 00000100:00100000:1.0:1782607808.780452:0:16333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7 00000100:00100000:1.0:1782607808.780466:0:16333:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455d463b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:32e35a33-83b5-4007-97ba-302ed8efa50a+17:2354:x1869199342434432:12345-192.168.202.4@tcp:4:dd.0 00010000:00010000:1.0:1782607808.780512:0:16333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078a5fb9b/0x8109266df35cc808 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607808.780603:0:16333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607808.780609:0:16333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782607808.780617:0:16333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078a5fb9b/0x8109266df35cc808 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607808.780634:0:16333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078a5fb9b/0x8109266df35cc808 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782607808.782880:0:16334:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 14343 00010000:00010000:2.0:1782607808.782902:0:16334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000407a177c/0x8109266df35cc7e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607808.782914:0:16334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000407a177c/0x8109266df35cc7e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607808.782923:0:16334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000407a177c/0x8109266df35cc7e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607808.782931:0:16334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97455d649600 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:2.0:1782607808.782936:0:16334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000407a177c/0x8109266df35cc7e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607808.782944:0:16334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000407a177c/0x8109266df35cc7e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607808.782966:0:16334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000407a177c/0x8109266df35cc7e5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607808.782973:0:16334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000407a177c/0x8109266df35cc7e5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607808.783045:0:16334:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:32e35a33-83b5-4007-97ba-302ed8efa50a+17:2355:x1869199342433792:12345-192.168.202.4@tcp:4:dd.0 Request processed in 239440us (240673us total) trans 8589934602 rc 0/0 00010000:00010000:3.0:1782607808.783615:0:16336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000700af607/0x8109266df35cc7f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.783626:0:16336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000700af607/0x8109266df35cc7f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.783634:0:16336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000700af607/0x8109266df35cc7f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.783641:0:16336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974442876e00 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:3.0:1782607808.783644:0:16336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000700af607/0x8109266df35cc7f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.783651:0:16336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000700af607/0x8109266df35cc7f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.783665:0:16336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000700af607/0x8109266df35cc7f3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.783685:0:16336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000700af607/0x8109266df35cc7f3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607808.783735:0:16336:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455d463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:32e35a33-83b5-4007-97ba-302ed8efa50a+16:2354:x1869199342434176:12345-192.168.202.4@tcp:4:dd.0 Request processed in 225230us (228642us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1782607808.783745:0:16336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4 00000100:00100000:2.0:1782607808.783982:0:16334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2 00000001:00080000:1.0:1782607808.825681:0:7525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00000001:00080000:1.0:1782607808.825704:0:7525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:1.0:1782607808.825872:0:14843:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:1.0:1782607808.825876:0:14843:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:1.0:1782607808.825892:0:14843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059d3f2d8/0x8109266df35cc801 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607808.825919:0:14843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059d3f2d8/0x8109266df35cc801 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607808.825929:0:14843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059d3f2d8/0x8109266df35cc801 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607808.825936:0:14843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9745585ac600 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:1.0:1782607808.825940:0:14843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059d3f2d8/0x8109266df35cc801 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607808.825949:0:14843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059d3f2d8/0x8109266df35cc801 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607808.825971:0:14843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059d3f2d8/0x8109266df35cc801 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782607808.825979:0:14843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059d3f2d8/0x8109266df35cc801 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782607808.826072:0:14843:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455d461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:32e35a33-83b5-4007-97ba-302ed8efa50a+11:2355:x1869199342434304:12345-192.168.202.4@tcp:4:dd.0 Request processed in 116313us (270834us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1782607808.826082:0:14843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 6 00010000:00010000:3.0:1782607808.827887:0:16335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f0afe6f/0x8109266df35cc7fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.827905:0:16335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f0afe6f/0x8109266df35cc7fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.827914:0:16335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f0afe6f/0x8109266df35cc7fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.827921:0:16335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974571007000 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:3.0:1782607808.827927:0:16335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f0afe6f/0x8109266df35cc7fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.827936:0:16335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f0afe6f/0x8109266df35cc7fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.827958:0:16335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f0afe6f/0x8109266df35cc7fa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782607808.827983:0:16335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f0afe6f/0x8109266df35cc7fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782607808.828078:0:16335:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455d461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:32e35a33-83b5-4007-97ba-302ed8efa50a+9:2354:x1869199342434048:12345-192.168.202.4@tcp:4:dd.0 Request processed in 119632us (272861us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1782607808.828090:0:16335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5 00010000:00010000:2.0:1782607808.849245:0:16333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078a5fb9b/0x8109266df35cc808 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607808.849264:0:16333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078a5fb9b/0x8109266df35cc808 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607808.849273:0:16333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078a5fb9b/0x8109266df35cc808 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607808.849280:0:16333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff974571006e00 already unused, calling callback (ffffffffc1797ce0) 00010000:00010000:2.0:1782607808.849287:0:16333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078a5fb9b/0x8109266df35cc808 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607808.849304:0:16333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078a5fb9b/0x8109266df35cc808 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607808.849327:0:16333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078a5fb9b/0x8109266df35cc808 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782607808.849334:0:16333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078a5fb9b/0x8109266df35cc808 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782607808.849442:0:16333:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455d463b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:32e35a33-83b5-4007-97ba-302ed8efa50a+7:2354:x1869199342434432:12345-192.168.202.4@tcp:4:dd.0 Request processed in 68976us (294181us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1782607808.849451:0:16333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7 00000001:00080000:1.0:1782607808.849951:0:7525:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:3.0:1782607809.540711:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782607809.602690:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782607809.602728:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff97457f384700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364436992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782607809.602829:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782607809.603157:0:14841:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364436992 00000100:00100000:2.0:1782607809.603166:0:14841:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364436992 00000100:00100000:2.0:1782607809.603221:0:14841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782607809.603231:0:14841:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97455d462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364436992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782607809.603264:0:14841:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3859808256 avail 3849322496 00000100:00100000:2.0:1782607809.603334:0:14841:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97455d462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869199364436992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607809.603343:0:14841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782607809.603429:0:3317:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:0.0:1782607809.603436:0:3317:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff974581008380, transno 8589934595 00000004:00080000:0.0:1782607809.603456:0:3317:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:0.0:1782607809.603494:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff97457f384700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1869199364436992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782607809.607730:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1869199364437376:0@lo:400:kworker.0 00000100:00100000:0.0:1782607809.607835:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607809.607893:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782607809.607900:0:3319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581008e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364437248:0@lo:400:kworker.0 00000100:00100000:0.0:1782607809.607928:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782607809.607981:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364437376 00000100:00100000:0.0:1782607809.607989:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364437376 00000100:00100000:0.0:1782607809.608061:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782607809.608072:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1869199364437376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782607809.608133:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1869199364437376:12345-0@lo:400:kworker.0 Request processed in 62us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607809.608141:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782607809.608197:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1869199364437376:0@lo:400:kworker.0 00000100:00100000:1.0:1782607809.608567:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974549e7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1869199364437504:0@lo:400:kworker.0 00000100:00100000:1.0:1782607809.608604:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607809.608644:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1782607809.608651:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974581008a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33f55b46-a882-437e-a0a1-2be6832a7ec1:3316:1869199364437120:0@lo:400:kworker.0 00000100:00100000:1.0:1782607809.608680:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607809.608701:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff974549e7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1869199364437632:0@lo:400:kworker.0 00000100:00100000:1.0:1782607809.608732:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782607809.608758:0:15977:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364437248 00000100:00100000:1.0:1782607809.608762:0:15977:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364437248 00000100:00100000:1.0:1782607809.608834:0:15977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782607809.608842:0:15977:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364437248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782607809.608880:0:15977:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1869199364437248:12345-0@lo:400:kworker.0 Request processed in 40us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607809.608887:0:15977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1782607809.608904:0:14200:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782607809.611907:0:14205:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364437504 00000100:00100000:0.0:1782607809.611926:0:14205:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364437504 00000100:00100000:0.0:1782607809.612094:0:14205:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364437632 00000100:00100000:0.0:1782607809.612098:0:14205:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364437632 00000100:00100000:0.0:1782607809.612142:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782607809.612153:0:14205:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869199364437504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607809.612478:0:15978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782607809.612499:0:15978:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff974443761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869199364437632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607809.612536:0:15978:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869199364437632:12345-0@lo:400:kworker.0 Request processed in 51us (3803us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607809.612544:0:15978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782607809.612700:0:14199:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199364437120 00000100:00100000:3.0:1782607809.612704:0:14199:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199364437120 00000100:00100000:3.0:1782607809.612741:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1782607809.612747:0:14199:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+19:3316:x1869199364437120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782607809.612817:0:14199:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33f55b46-a882-437e-a0a1-2be6832a7ec1+19:3316:x1869199364437120:12345-0@lo:400:kworker.0 Request processed in 70us (4136us total) trans 0 rc 0/0 00000100:00100000:3.0:1782607809.612825:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1782607809.612907:0:3319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581008e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1869199364437248:0@lo:400:kworker.0 00000100:00100000:3.0:1782607809.612957:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974581008a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33f55b46-a882-437e-a0a1-2be6832a7ec1:3316:1869199364437120:0@lo:400:kworker.0 00000100:00100000:3.0:1782607809.613000:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974549e7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1869199364437632:0@lo:400:kworker.0 00000100:00100000:3.0:1782607809.613130:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff974549e7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1869199364437504:0@lo:400:kworker.0 00000100:00100000:0.0:1782607809.613385:0:14205:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff974443761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869199364437504:12345-0@lo:400:kworker.0 Request processed in 116us (3662us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607809.613395:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1782607809.614429:0:14200:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782607810.562017:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782607810.846723:0:16375:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1782607811.587307:0:14192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782607811.827312:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607811.827356:0:15978:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342434688 00000100:00100000:1.0:1782607811.827366:0:15978:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342434688 00000100:00100000:0.0:1782607811.827374:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607811.827396:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607811.827421:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1782607811.827425:0:15978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 28 00000100:00100000:1.0:1782607811.827435:0:15978:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:32e35a33-83b5-4007-97ba-302ed8efa50a+20:2357:x1869199342434688:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1782607811.827452:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607811.827468:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607811.827484:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1782607811.827508:0:14839:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342434944 00000100:00100000:0.0:1782607811.827515:0:14839:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342434944 00000100:00100000:0.0:1782607811.827553:0:14839:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342435200 00000100:00100000:0.0:1782607811.827555:0:14839:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342435200 00000100:00100000:0.0:1782607811.827628:0:14839:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342434816 00000100:00100000:0.0:1782607811.827631:0:14839:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342434816 00000100:00100000:0.0:1782607811.827643:0:14839:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342435328 00000100:00100000:0.0:1782607811.827645:0:14839:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342435328 00000100:00100000:0.0:1782607811.827656:0:14839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16 00000100:00100000:0.0:1782607811.827661:0:14839:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+5:2357:x1869199342434944:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1782607811.827749:0:14840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 17 00000100:00100000:2.0:1782607811.827757:0:14840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b859eba-a064-4697-844f-1f4595f38a4c+5:2357:x1869199342435200:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1782607811.827901:0:15978:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:32e35a33-83b5-4007-97ba-302ed8efa50a+20:2357:x1869199342434688:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 466us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607811.827908:0:15978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 28 00000100:00100000:1.0:1782607811.827924:0:15978:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342435072 00000100:00100000:1.0:1782607811.827927:0:15978:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342435072 00000100:00100000:1.0:1782607811.827950:0:15978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 29 00000100:00100000:1.0:1782607811.827957:0:15978:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b859eba-a064-4697-844f-1f4595f38a4c+6:2357:x1869199342435072:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1782607811.828187:0:14839:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+5:2357:x1869199342434944:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 524us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607811.828195:0:14839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16 00000100:00100000:0.0:1782607811.828208:0:14839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 18 00000100:00100000:0.0:1782607811.828215:0:14839:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+5:2357:x1869199342434816:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1782607811.828301:0:14839:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:32e35a33-83b5-4007-97ba-302ed8efa50a+5:2357:x1869199342434816:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 49us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607811.828308:0:14839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 18 00000100:00100000:0.0:1782607811.828318:0:14839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 19 00000100:00100000:0.0:1782607811.828324:0:14839:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff97457f4b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b859eba-a064-4697-844f-1f4595f38a4c+5:2357:x1869199342435328:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1782607811.828343:0:14839:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b859eba-a064-4697-844f-1f4595f38a4c+5:2357:x1869199342435328:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 20us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607811.828348:0:14839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 19 00000100:00100000:0.0:1782607811.828364:0:14198:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869199342434560 00000100:00100000:0.0:1782607811.828366:0:14198:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869199342434560 00000100:00100000:0.0:1782607811.828387:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 123 00000100:00100000:0.0:1782607811.828392:0:14198:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9745676de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e6cd414-a5bd-4223-b33a-76eff85902b7+13:2357:x1869199342434560:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1782607811.828417:0:14198:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9745676de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e6cd414-a5bd-4223-b33a-76eff85902b7+13:2357:x1869199342434560:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 25us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1782607811.828423:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 123 00000100:00080000:0.0:1782607811.828464:0:14200:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782607811.828468:0:14200:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782607811.828470:0:14200:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782607811.828886:0:14840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b859eba-a064-4697-844f-1f4595f38a4c+5:2357:x1869199342435200:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 1128us (1486us total) trans 0 rc 0/0 00000100:00100000:1.0:1782607811.828886:0:15978:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff97457f4b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b859eba-a064-4697-844f-1f4595f38a4c+6:2357:x1869199342435072:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 927us (1414us total) trans 0 rc 0/0 00000100:00100000:2.0:1782607811.828894:0:14840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 17 00000100:00100000:1.0:1782607811.828901:0:15978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 29 00010000:00010000:2.0:1782607812.617208:0:14193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29796 lines, 29796 kept, 0 dropped, 0 bad.